% 

ED 210 018 



DOC GHENT RESUME 

IE 009 820 



AUTHOR 
TITLE 



INSTITUTION* 

REPORT NO 
POB DATE 
NOTE 

AVAILABLE FROM 



Divilbiss, JU L., Ed. 

Public Access to Library Automation. Clinic on 

Library Applications of Data Processing (17th, 

University of Illinois at Hrbana-Champaign, 1980)* 

Illinois Univ*., Ufbana* Graduate School of library 

and Information Science* 

ISBN~0-87B*5-.065-3 

81 

132p*; Some figures and tables in small print may not 
reproduce clearly* 

Graduate School of ~ Library and Information Science, 
Publications Office, 2<J9 Armory Bldg., 503 E* Armory 
Street, Champaign, IL 61820 ($10*00)* 



EDPS PRICE M.F01 Plus Postage- PC Not Available from EDB5* 

DESCRIPTORS Cataloging: Consumer Economics: Disabilities; 

♦Information Retrieval: *Information Systems; Input 
Output Devices: *Library Automation: *Library 
Technical Processes: Ban Machine Systems: *Online 
Systems: User Satisfaction (Information): Use 
Studies 

IDENTIFIERS ^Access to Information 
ABSTRACT 

Eight studies* by experts in the field- of information 
retrieval examine aspects ox public use of such automated systems as 
online catalogs in libraries* Hard Shaw discusses "Design Principles, 
for Public Access," outlining desirable characteristics of an 
information retrieval system, Allen Avner and H. George Friedman, Jr. 
treat problems with present information systems in "Interacting with 
Computer Users: Design Considerations," while Christine L* Eorgman 
and Neal Kaske deal with equipment needs in "Determining the 
Numter of Terminals Required for an On-Line Catalog through Queueing 
Analysis of Catalog Traffic Data*" Hargaret Beckman addresses system 
design ixi "Public Access at the University of Guelph Litrary," and 
Thomas T* Hewett and Charles T. Meadow f s "A Study of the Measurement 
of User Performance" presents data on the successes and failures of 
information retrieval systems at various libraries* Problems 
encountered by novices are discussed by Mark S.„ Fox and Andrew J* 
Palay in "Machine-Assisted Browsing for the Naive User*" Problems 
encountered by the handicapped in using information systems and* 
solutions for individual handicaps are presented in Gregg 
Vanderheiden f s "Modifying and Designing Computer Terminals to Allow 
Access by Handicapped Individuals* " The final paper is Allan H* 
Levy's study from the health care field, "Resistance to Technology: 
Some examples from the Health Care Delivery System*" An index is 
provided* (RAA) 



******************** ********* ****************************************** 

* Reproductions supplied by EDRS are the best that can be made * 

* from the original document. * 

***************************** ************* ******* ** * *** ** **** J***** ***** 



ttJk OEFAKTMCNT Of EDUCATION 
NATIONAL INSTITUTE OF EDUCATION 
EOUCATtONAt RfcSOURCES INFORMAIlON 
CENTER (ERIC) 

ii Trw documem hat been reproduced a* / 
received from the f**pp or organization / 
oo^«oo tog rt. 

□ Mux* changes have been m*4e to improve 
reproduction quality. 



• Ponis of v»ew or options stated to th» docu- 
ment do not necessary represent official NlE 
position or pobev. 



/ 

y 



Public Access to 
Library Automation 



Edited by 
J.L. DIVILBISS 



"PERMISSION TO REPRODUCE THIS 
. MATERIAL IN MICROFICHE ONLY 
HAS BEEN GRANTED BY 

Linda K. Hoffman 



TO THE EDUCATIONAL RESOURCES 
INFORMATION CENTER (ERIC)." 



Graduate School of Library and Information Science 
University of Illinois at Urbana-Champaign 



Library of Congress Cataloging in Publication Data 

Clinic on Library Applications of Data Processing 
(17th : 1980 : University of Illinois at Urbana- 
Champaign) * 
Public access to library automation * 

Includes index. 

1. Libraries-Automation-Congresses. 2. Library 
science-Data processing-Congresses. 3. Libraries 
and readers-Congresses. I. Diviibiss, J. L. 

II. University of Illinois at Urbana-Champaign. 
Graduate School of Library and Information Science 

III. Title. 

Z678.9.A1C5 1981 025.3'028'54 81-' 1685 
ISBN 0-87845-065-3 AACR2 



1981 by The Board of Trustees of the University of Illinois 



CONTENTS 




Introduction 



1 



J.L. DIVILBISS 



besiga Principles for. Public Access 



2 



WARD SHAW 



1 



Interacting with Computer Users: 



Design Considerations ; 

ALLEN AVNER 

H. GEORGE FRIEDMAN, JR. 

Determining the Number of Terminals Required for 
On-Line Catalog through Queueing Analysis of 
Catalog Traffic Data 

' CHRISTINE L. BORGMAN 
NEAL K. KASKE 

Public Access at the University of Guelph Library 

MARGARET BECKMAN 

A Study of the Measurement of User Performance . 
THOMAS. T. HE WETT 
CHARLES T. MEADOW 

Machine-Assisted Browsing for the Naive User , . 
MARK S. FOX 
. ANDREW J. PALAY 

Modifying and Designing Computer Terminals to 
Allow Access by Handicapped Individuals . . . • 

GREGG VANDERHEIDEN 

Resistance to Technology: Sdme Examples from th< 

Health Care Delivery System 

ALLAN H. LEVY, M.D. 



Index 



126 




4 



Introduction 



Of the various trends in library automation today, public access is clearly 
one of the most difficult, complex, and potentially rewarding areas of 
development. The motivation may be economic or it may be the desire to 
offer a new standard of service; in either case the designer of a public access 
system finds himself in largely uncharted waters. In plannu^ the 1980 
clinic we attempted to bring together speakers who could address both the 
philosophical foundations and the nuts-and-bolts reality of public access. 
As an example of the former, Shaw points out how little we know about 
public use of automated systems. He then makes the persuasive argument 
that our best chance for understanding and improving man-machine 
communication is through heuristics. Hewett and Meadow continue this 
theme with a detailed discussion of an experiment to determine how 
effective an overlaid analysis and assistance program could be to untrained 
users of an "information retrieval system. Their encouraging results have 
implications that extend to many other areas of public access/In her paper, 
Beckman describes the practical considerations that arise in providing 
public access in a university library. In summary, the common theme of 
these papers is that providing well-designed public access systems will be 
an uncommonly challenging task, but that early results give us cause for 
great optimism. 

JX. DIVILBISS 
Editor 
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Executive Director 
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Design Principles for Public Access 



. Basically, the problem of designing an information system for public 
access is the same as the problem of designing any kind of system and 
perhaps can be stated as a question: How do we construct or plan that 
interaction of hardware, software, people, and data that will be most likely 
to lead to a predetermined good or goal? Ideally, we should have a fairly 
good idea of what the goal is, an understanding of the mechanism of the 
change required to meet the goal, and a comprehension of the characteris- 
tics of the interactions of hardware, software, people, and data, so that we 
may apply those 'characteristics to the design and control of the events 
necessary to cause the change desired. Traditionally stated, this means- 
define the output, define the input, and then invent a process that will 
transform the input into the output. 

The trouble is that when it comes to the design of information sys- 
tems and particularly public access information systems, it is extraordi- 
narily difficult to reach clear definitions of output or input; and, moreover 
nearly impossible to define a process that will transform one into the other' 
That is why it is fundamentally easier to design a system to send a man to 
the moon by 1970 than to design an information system . You Know where 
the moon is, and can learn a great deal about its characteristics. You know 
what a man is, and much about what his biology enables him to do; you 
know when 1970 is; and there exists a corpus of knowledge of mechanics 
that allows construction of a process that will get the man to the moon- 
that is, the problem is well defined and a solution is at least comprehensi- 
ble. What remains is essentially a mechanistic exercise. However in 
designing information systems, it is not enough to define input as those 
keys which a user strikes on a keyboard, and output as those records or_ 
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messages which appear on a screen-surely we must pay attention to those 
things! but they do not treat the whole system. Information, like most 
»-tion" words, is a process-specifically, that process by which people 
become informed. Therefore, input becomes "an uninformed-person and 
output becomes "an informed person." But those are very fuzzy concepts, 
and that is particularly true of systems for public access. The basic differ- 
ence between systems for public access and systems for "private access is 
that in the latter case, the designer can assume boundaries and hence some 
specification of the "uninformedness" of the user. He can also assume a 
certain degree pf understanding by the user of what the system is supposed 
to do and through that, can reduce his problem to that of defining a data 
retrieval or manipulation system. But in the case of systems for public 
access such assumptions are perilous at best, because many different users 
of many different degrees of confusion will attempt to use the system for 
many different things; success will be measured not by such easily quantifi- 
able things as relevance/recall ratios or numbers of documents delivered, 
but rather by user satisfaction. 

To confuse the issnrfarthcr. we don't know much about tbmrocessj?/ 

informing, that is, how uninformed people become informed people. We 
do know that the process is closely related to, or perhaps equivalent to, 
learning, but we also know that educational theory is notoriously inade- 
quate in describing exactly how to cause learning to occur. To return to 
something tangible, consider some of the questions that ought to be 
addressed in designing a computer-based public access mformat.on 
system— for example, a catalog: 

1 How fast should system response be? Should the terminal display mes- 
' saecs at reading speed so that users can read along as the terminal is 

responding, or should messages appear all at once for the user to read at 
pleasure? (If you think this simple characteristic is unimportant try an 
interactiv e system at SCO baud and then try the same system at 9600 baud. 
You'll likely find that the system "feels" completely different and that 
this "feel" affects your perception of it and its utility. But which is better, 
for what "kinds of interactions?) 

2 How much data, in what detail, should be presented, and at what stage 
' of the interaction? If you present bibliographic records, how many 

elements are necessary? When does the format get in the way of useful 

3 How m a uch n? should users by involved in or contfol the interactive pro- 
cess' In a catalog, should the user who enters "Mark Twain be 
informed that the correct name is Samuel Clemens and that the system 
will proceed with Clemens, or should the system substitute! wain for 
Clemens automatically, or should (for pedagogical purposes) the 
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system require the user to acknowledge (or even retype) the change to 
Clemens ? What .s the specific effect on the informing process of each 
of these options? 

4. When should the system qui,? That is, at what point can theuser becon- 
sidered to be "informed" and how is this measured? If left to user 
control, will he choose to quit before he "should" (for example, before 
the system directs him to periodical resources in addition to mono^ 
graphs)? Or is it better to make the system totally passive in this regard? 
Clearly, the problem of identifying principles of system design for public 
access is a difficult one, and weccrtainly do not know enough about public 
access information systems to generate very many "rules" that can be 
Pmcet-d? 3 Pri ° ri '° gUaramCC 3 " g °° d " s y stem desi S"- How - '^n, do we 
We really know only three ways to approach design. The most fre- 
quently used, and usually the best, is^healgorithmic method. This method 
is characterized by the systematic application of rules or formulas which 
will lead to the desired results. But, as we have seen, in the case of public 
tost "information sysTems, we ^oWlIHder^d" enough about 
information-seeking behavior and the informing process to use this 
method successfully. In fact, we will probably generate this knowledge 

only throughanalys.softheuseofmanypublicaccess information systems 
over a considerable time; and, if ,he analogy to learning holds, we may 
never understand the process. 

The second method is simulation. This method consists of creating a 
model of whatever it is you want to learn about (in this case, an inclina- 
tion system). I he model must have two characteristics: ( 1 ) it must represent 
the real world accurately with regard to significant variables, and (2) it 
must be capable of being efficiently and repeatedly exercised. The process 
■s to run the model many times, each time changing one of the variable 
values, to learn which ch- A cs produce desirable results and which pro- 
dine undesirable results. , he problem is that it is very difficult to identify 
the relevant variables in information-seeking behavior, and much more 
difficult to derive accurate and representative relationships among those 
variables We simply do not have a very good model availably nor does it 
appear likely that we will get one soon. 

The third approach to design is the heuristic method, and I believe it 
to be the most promising approach to the design of systems for public 
access. Essentially, the heuristic methodology is as follows: in a case in 
winch the designer does not understand enough about t he mechanisms of a 
particular situation to invent appropriate algorithms-e.g., the case of 
public access systems-he generates a number of statements of value, or 
targets, which he believes will lead to desirable results. These statements of 
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value are called heuristics, and perhaps the most common examples of 
systems developed using this approach are many of the chess-p aying 
programs. It is clearly impractical to design algorithmic chess-playing 
proerams. Thereare too many possible moves for even the fastest computer 
to evaluate. So, heuristics are developed-for example, "it is desirable to 
take your opponent's pawns," or "it is desirable to trade pieces of lower 
mobility forpieces of higher mobility," or "it is desirable to move powerful 
pieces quickly to the front." These moves will not guarantee that the 
* program will win chess games, but most players believe that they are likely 
- to lead to success. Thus, the designer develops his program to evaluate a 
few possible moves in any given situation, measuring their value by 
determining which of the heuristics they might satisfy. Value in the case of 
chess can, of course, be represented numerically, and the program can 
"score" possible moves to identify the "best" one. 
*k A key element of the heuristic approach is feedback. Heuristics or 
value statements are developed and assigned a particular numeric value at 
the beginning of system use. The system, as it is exercised, monitors us 
success, and by tracking itself, modifies the numeric values or weights 
assigned to its various heuristics, seeking more frequent success. In this 
sense then, the chess programs are self-modifying and ' learn" from expe- 
rience, becoming more and more likely to win. Of course, how good they 
get depends in considerable measure on how intelligently the original 
heuristics were selected, and it is therefore axiomatic that the software be 
designed for easy modification so that new heuristics can be added and 
useless ones removed. 

Let's look again at the example of designing a public access catalog. 
Wedon't know exactly how to produce informed (or satisfied) users; that is 
to say we do not understand the mechanisms by which uninformed users 
are transformed into informed users. Consequently, it is difficult to see 
how to apply the algorithmic method to the design of public access 
catalogs We furthermore do not have a model of the information process 
thaC yields much confidence in its "goodness of fit," and so thesimulation 
method does not appear very helpful. But we can identify heuristics- 
statements of value-about the behavior of an information system which 
might lead toward informed users, and if that isso, the heuristic method of 
desig.i is probably the best bet. Remember that we are looking at the 
.nformation system as a whole-not simply the hardware and software, but 
also the users and the data. _ 

At the design level, there are many heuristics that might be identified. 
F allowing are a few examples, not intended to be exhaustive by any means, 
but rather illustrative. These statements may or may not be true, but do 
begin todescribe a corpus of system characteristics which will lead directly 
to an initial system specification and a description of a process for a ystem 
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evolution or "self-tuning" as described above. First, there are a number of 
things we might say about the interaction of users with the rest of the 
system. 

1. It is desirable (i.e., will lead to information) that the system allow the 
user maximum entry possibilities. That means that, for example it is 
better to have indexes to ten data elements than to have indexes to five 
data elements. Thus, if you are deciding whether to provide access to the 
bibliographic records by ISBN, it is desirable to do so. Note that these 
kinds of decisions involve trade-offs, and the set of heuristics or value 
statements provides a framework for formalizing, controllingand even- 
tually enhancing those trade-offs. 

2. It is desirable that the user be able to ask thesystem for help at any point 
in the interaction, and that the help supplied be relevant. This means 
that a general-purpose "help" file is inadequate. Explanatory informa- 
tion presented to users should reflect where they are in the interaction 
the path they have taken to get there, and the substantial data they are 
working with. This will probably require some code to generate 
appropriate responses on a semi-individual basis 

3. It is desirable that the user control the interaction, i.e., the user^hould 
feci like he is drivingthe machine rather than the other way arourfcHThe 
idea is that the macfiW should be responsive to the user 

4. It is desirable that the Whine react to the user at the usei's skill 
level Novice users may net-H considerable instruction and step-by-step 
guidance during the interacW but skilled users should not be con- 
fronted with repetition of insWtions they already know 

5. It is desirable that the machinV respond with data that appropriately 
answer a user's need. Messages Should neither overwhelm nor •'under- 
whelm" users. For example, if a freshman asks for a book on American 
education, it is not helpful for/ the machine to respond with biblio- 
graphic listings of all 600 of thei^On the other hand, if someone wants 
a technical discussion of RommeUs Africa campaign, a response direct- 
ing them to a general history of wljY isWly to be less -nan informative. 

These arc examples of statements that wilkllow basic design decisions to 
be made from the point of_view of the useYs*Qf the system. All involve 
trade-offs, all may or may notEe^tmc^and all wa^prove to be impossible, 
but they at least provide a framework TorHesTgn decisions. 

Similarly, there are any number of heuristics relating to the hard- 
ware/software area, and examples of these are presented below. Because 
oneof the important considerations in heuristic design is theability of the 
system to change, the first four examples relate to flexibility. 
1 It is desirable to structure hardware and software in a modular fashion 
The idea is that pieces of thesystem can be easily modified without dire 

10 



DESIGN PRINCIPLES FOR PUBLIC ACCESS 



consequences to the rest of the system. 

2 It is desirable that constant values be passed to software as variable 
• ' values A specific case of this is table-driven terminal control, and the 

benefit is that the constant values can be easily changed to meet different 
circumstances. 

3 It is desirable that message content and message form be separated. Foi 
' example, in designing screens it is far easier to deal with one software 

unit which formats information and another which collects the variable 
data to be presented than to deal with both at once. 

4 h is desirable that data structures be as flexible as possible. As soon as 
* you have designed an on-line catalog, someone will come along and 

insist that you turn it into a circulation system as well. If, for example, 
you are restricted by design to fixed-length records of fixed-length fields, 
this becomes difficult to accomplish. 

5 It is desirablethat terminals have considerable graphics capability. 1 his 
" ' will lead to increased capabilities. Some kinds of data are best presented 

in text or list form, but consider the difficulty of describing a map over 
the telephone. In that case, a picture does the job far better. This is 
probably also the case with exposing the syndetic structure of a catalog 

to its users. _ . , 

6 It is desirable to minimize the time the machine spends accessing Disk 
' files The most common critical, limiting bottleneck in on-line biblio- 

eraphic systems is the time the machine spends accessing index records 
and bibliographic records from disks, and the designer will do wonders 
for response time by attending to this at the design stage. 
These then, are examples of heuristics that, taken together and expanded, 
will probably lead to successful designs. None are true a priori, but we 
believe that they may lead to successful design. 

Theprocess, therefore, is toselectasetofheuristics.andcarefully state 
them These will describe characteristics of the hardware, software, data, 
and interaction which the designer believes will lead toasuccessfu system. 
The next step is to assign some relative value to each statement. The result 
will be a mechanism for making design decisions and trade-offs Then, 
using these valued heuristics, the system can be designed. It can then be 
tested and, based on the results, the heuristics and the values assigned to 
them can be modified. In a continuous process, the system implementation 
will be changed to reflect these changed values. This recursive process, it is 
ho-ed will at some point stabilize. At that point, the heur.st.es and 
associated values will becom£,potential principles of des.gn for public 
access The heuristic%effi6aTi then, is a codification of and control mecha- 
nism for the rough-and-ready approach that says "put something up and 
then tinker with it"-andl believe it offers the best hope of developing and 
learning about successful public access systems. 

O 
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Interacting with. Computer Users: 
Design Considerations 



The design of computer terminals which communicate with naive users in 
a humane yet effective manner involves problems that are common to 
many applications. Interactive computers are being used as everyday toois 
m settings that range from airlines to zoos. The problem* met by the 
growing use of computer terminals in libraries are seldom unique to that 
setting. In fact, the experience of the authors over the past two decades 
suggests the existence of a set of design problems that turn up whenever 
interactive computer terminals are used, whatever the setting. These hin- 
drances emanate from inappropriate dependence on a few simplifying 
assumptions that make design easier at the cost of lowered eHw.iveness 
This paper outlines six of these fallacious assumptions, describes the 
reasons for their beguiling attractiveness, and suggests alternative views 
that should lead to better design. 

» 

Human-Machine System Design 

Human-machine interactions may be considered to consis- of four 
, major elements: task, procedure, human, and machine. The good system 
< designer does not assume that any of these elemenrs is$ static, unchange- 
able factor that can be ignored. A thorough arcrifas may even reveal 
alternative approaches which eliminate tjieneed for a special design. 

Task 

The task is the problem that is to be solved. A common error is the 
failure to understand that past views of the problems may have been 
limited by what was possible with tools and procedures then available. 

ERIC 
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New tools may make it ,>ossibte to solve a larger problem Where this .s the 
case the task should-bFdefined to include factors not addressed by former 
approaches. An example common in computerization is that a computer 
" brought in to simplify paperwork also turns out to be able to solve a part of 
the management process that the paperwork supported. Thus, a computer 
brought in to automate the p.oduction of book purchase orders would also 
I* able to automate man) of the standard administrativedecisions made in 
following up on overdue deliveries. However, this added capability is 
likely to lie included in thedesiguof the system only if thedesigner is aware 
of the total task. 

Procedure , . 

Proreduies aie the methods used to complete a task. A common en or is 
the confusion of procedures with tasks. A procedure (such as filling out a 
charge slip foi a liook by hand) comes to be seen as a required part of an 
opeiation. rathe, than as simply one of several means of performing the 
actual task (Ina.ntaining a record of changes in responsibility for a book). 
Tins pa.t.cular confusion often results in technological misapplications 
that meet task needs b> the simple, but usually inefficient, expedient of 
mimicking old pioceduies. ... , 

Another form of c (infusion of cask and piocedure results in the endow- 
ment of a piocedure with almost magical powers. Thus, "coinputen/a- 
non" may be cited as the leason foi success of a new approach. I hat success 
,s then used as the .easo.i for blindly adopting computers in other s.tua- 
„ons without taking the tumble to determine what alternates might be 
available One result of such blind adoption of computers is the growing 
'number of cases wheie an administrate "computerues" an operation, 
shows meat savings in time and money, and is pionioted He is then 
replaced by a new ad.nin.strato. who is miraculously able to eliminate the 
computer without losing the advantages of "romputeruation ! If the Ux* 
adininistiator had taken the time to examine the actual .ask and the 
possible alternatives, he would have observed that all that was really 
needed was. a it-structuring of the task. The apparent gains derived from 
computerization in such cases ,eally result from the task restructuring that 
accompanies the unnecessary addition of a computer. The computer can 
be dropped from such an implementation with minimal effect on working 
efficient* and substantial savings in cost. Needless to say, cost savings 
would have been even greater if the computer had never entered the scene. 

Human , . „.. 

Humans appear in many roles in human-machmesy.stems. I hey may 
help the machine carry out procedures, or they may be clients served by the 
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Figure I. Pew-are of lechnological innovations ihai simply mimic old procedures. 
nius«a.ions for (his paper were drawn by Wayne Wilson. Compu.cr- based Educanon 
Research Labora.ory. I'msersny of Illinois a. Urbana-Champa.gn. Wucation 



system. The major error lies in ignoring the human clement. A designer 
may assume that since he or she is human, any system design will automat- 
ically include all needed, human factors. That is not so. Humans vary 
enormously in training, motivation and ability. Not only do thev vary 
individually, but they vary with time. A system designed for nalv- users 
may not be efficient for experienced users. Users who begin as naive users 
will seldom rrmain that way with time. A system that is comfortable for 
br-ef human use can be an unbearable burden when used continuously for 
long hours. Good design demands a clear view of thenatureof the humans 
who will interact with the system and the nature of that interaction. 

Machine 

The word machine is used here because we happen to be discussing 
computers. A more accurate word would be tool. The maciuneor tool is a 
technological aid to application of the procedure. A pencil or an instruc- 
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tional technique is just as valid a form of technology as a computer It is a 
' mistake to assume that some complex form of technology is needed for 
every task. As was noted above, careful restructuring of a work situation 
can result in substantial improvements in productivity without any need 
for a computer cr other expensive technology. 

Modularization 

Once the major components of a human/machine process have been 
identified, good design practice dictates that the resulting system be further 
broken down into functional modules that cut across these major compo- 
nents. Each functional module performs a single distinct function in the 
»Turion of the overall task. A particular module is defined by the portion 
S the total task that it covers, the procedures needed to address that 
subtask, and the human and/or machine carrying out those procedures. 
EST «Ke has well-defined inputs and outputs, and most modules 
interact only with other modules. . 

Modularization is not done simply in response to an innate drive o 
system designers to categorize things. Modularization a lows concurrent 
development of the many parts of a complex system by different group. .of 
de Sncrs operating in relative independence, thus greatly reducing the 
iS of time between initial planning and putting a system into opera- 
tion Modularization also has advantages in the completed product. 

Both hardware (the terminals, computers and other devices associated 
with the system) and software (the computer programs which guide the 
h 5wa e a'nd interpret interactions between hardware and humans) can be 
modularized. Modularized hardware is easier to maintain, smce modules 
that serve only a single, well-defined function are easier to isola e should 
net mal unction. Modules are also amenable to quick, nexpensive repair 
* by^s Ltion, Properly designed modular hardware is also more easdy 
altered or expanded to meet changing needs of a given insta H*™- F« 
example, needs for additional terminals or increased information storage 
capability can be met simply by adding the needed ^^i?**' 
control modules required to interface it with thcoriginai sy fl em. Thesame 
expansion in a nonmodularized system might require major redesigmng 
S both hardware and software. Modularized software has similar advan- 
tages in identification and repair of problems and in modification of 
existing installations. _ . _ 

Unfortunately, the advantages of modularization can cause a designer 
to downgrade the importance of other design considerations. For example 
modularization is easiest when the task structure ^relatively simple and 
when there are few interactions between tasks or procedures of different 
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™n£ , mg such f Sim P hcit y- 2 g°° d designer tries to eliminate 

extraneous elements from the task that the system is to perform. Under 
ume pressure, however, such commendable parsimony can lead to over- 
simplification. Overs.mplification results either from failures of commis- 
sion (misinterpreting a user's description of the task) or failures of 
omission (failing to verify that an interpretation of the task actually leads 
to an acceptablefmal result). Thefault in failures of omission is not alwavs 
with the system designer alone. A user who is not familiar with the 
computer s slavishly literal interpretation of directives may fail to specify 
the crucial decisions that areoften made by a human faced with ambiguous 
mformation. A human is able to make commonsense interpretations that 
may result ,n the job s completion despite less than ideal information A 
computer programmed with an oversimplified procedure for handling the 
same ambiguous data may merrily grind out stacks of absolute rubbish 
Eventually such failures will come to light, of course, but it is far mc,-e 
efficient to identify them at the time the system design is being specified. In 
thesearjy design stages, no amount of experience in computer system 
dt^gn can replace the knowledgeable guidance of a person who nas 
actually carried out the m-iginal task under "real-life" conditions 

With this general baclcground, let usexaminesix of the most common 
fallacies that intrude on the design of interactive computer terminal S ys- 

PC ° nCey ° U 3re 3Ware of lhesepitfalls togood design, you 
will be better able to guide design or selection of an interactive terminal 
system that will meet the special needs of your application. 

The Fallacy of Subsystem Independence 

The person followu, this erroneous design principle assumes that 
any component of a system can be designed effectively without any kno* ',- 
edge of the rest of the system. It is both convenient and useful to handle 
design of a system by breaking the major system into component modules. 
This does not mean, however, that the final system is intended to function 
as a set of independent modules. 

Problems of the "Fallacy of Subsystem Independence" show them- 
selves most frequently in hardware interactions. At the lowest level the 
user migh t encounter massivedelays in accessing or storing information at 
a terminal that is mismatched to a communications channel or storage 
device, rhe fact that two such components can be made to communicate 
with earn other by means of intermediate software or hardware does not 
necessarily mean that the interaction will be efficient. 

At a more complex (and, unfortunately, moreoften observed) level a 
system might perform a variety of functions quite well when thesystem'is 
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supporting only one user. However, a system which has not been designed 
as aV integrated whole may show severely degraded performance when 
asked to support different operations simultaneously by several users at 
different imeractive terminals. It may even degrade severely simply as a 
result of user loads above some moderate level. 



The Fallacy of System Function 

The motto of the believer in this fallacy is "If it works, the design is 
okay " No designer intentionally designs a system that is difficult to use. 
performs inefficiently, or assumes an inordinate amount of skill on the 
par. of ihc user. Nevertheless, under pressure to produce a functioning 
system while facing the ever present time deadlines and funding limita- 
tions that mark reality, designers are too frequently willing to accept 
almost anything that actually gets the intended task done. They may have 
started out with far grander intentions and an abiding desire to produce a 
system that would be both a joy to use and a paragon of efficiency. But in 
thecold. hard dawnof reality (and corporate solvency), they may have been 
willing to compromise with something that met the minimum specifica- 

lions of the contract. 

Given the tendency of humans to compromise when under pressure it 
is wise to make sure that minimal contractual specifications will actually 
provide acceptable levels of performance in the finished system. To insure 
lhat minimal specifications are adequate, one must go beyond s,m e 
statements of.input information and output products. One must uknt fy 
important conditional factors such as speed and ease of operation and 
spiify the operating condition under which these performance levels are 

eXPC £tystem must be expected to perform differently under different usage 
loads In recognition of this fact of life, the levels of performance required 
under a "normal" load and under the most severe load anticipated should 
both be specified. We must always remember that even . a system works 
(Ye pr educes the desired results under ideal conditions). ,t will not neces- 
sarily be acceptable to users (i.e.. produce .he desired results in a real life 
setting). 

The Fallacy of Human Perspicacity 

This fallacy is committed by most persons involved with Redesign , of 
interactive systems. The assumption that all humans will think exac ly the 
vay you think (and that they will automatically understand your intent at 
each step of an interaction is woefully common. The more involved a 
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designer becomes with the mechanics of getting a system to "work " the 
more he or she grows accustomed to the idiosyncratic manner in which it 
happens to operate at that moment. After a while, the designer forgets that 

ZZZ: 1 n °Lr '° thC SyS,m W " h 3 ful1 undemanding of th 
intent behind each human-machine interaction. 




The day of reckoning arrives with the first use by people who were not 
invoked withthe original design. If ,he designers are v4e, such people 
will be brought in well befoie the design of human-machine interactions 
has been frozen. Careful study of the problems encountered by naive nsers 
will greatly a,d in reducing potential errors and in increasing the ease of 
interaction. If the designers are not wise, they will delay exposure of the 
system to realistic field testing until final delivery of the system. Systems 
designed under this "blind" approach are most notable for their literary 
contribut.ons-a frantic, last-minute effort to compensate for poor human 
engineering by provision of a flood of instruction manuals. In general the 
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less often a user interacts with a computer terminal, the less voluminous 
the printed instruction manuals should be. A well-designed interactive 
computer system provides complete interactive prompting for the new or 
infrequent user. Ideally, one should be able to start a new user by simp y 
saying, "Follow the directions on that screen." Assuming reasonably 
literate users, anything less than this should be taken as a possible sign of 
limitations either in hardware capabilities or, more likely, in software 
design. 

The Fkllacy of Human Memory 

: A fallacy which is particularly prevalent in the design of information 
and instruction displays for interactive terminal systems is theassumption 
that humans can remember every detail of information encountered several 
minutes or even seconds before. This fallacy is actually a special caseof the 
"Fallacy of Human Perspicacity" and is perpetrated for the same reason. 
After many days ot working with the structure of a system, one forgets that 
someone seeing the system for the first time will, for example, actually be 
using instructions as sources of new information and not simply as mile 
markers on a familiar path. 

In the brief exchanges characteristic of use of interactive computer 
terminals, humans depend mostly on short-term memory. This is thesame 
type of memory that we use for tasks such as remembering a telephone 
n umber from the time we look it up in a directory to the time we dial it on 
the telephone. Short-term memory normally has a very limited capacitv 
(about three to four simple items or groups of items) and is easily overwrn 
ten by new information. 1 It is not reasonable to expect people to take the 
time to memorizedirectionson adisplay which they have little intention of 
usine frequently. Nor, given the limitations of short-term memory is it 
reasonable to expect a human to remember an item of intaat.ot.from 
onedisplay and combine «t with information trom another display. While 
this is a task that can be done, it is a task that forces a human to do 
something a computer can do far better. 

Well-designed interactions provide directions appropriate to the 
needs of the wr at the moment they are needed. Well-designed interac- 
tions also keep track of information acquired by the user (e.g., in a search 
procedure) and permit easy recovery of jhat information. For , ^mple 
after completing a complex search operation, the user should be atte 10 
make a minor change in specifications and start a new search without 
having to retype the full set of specifications. 
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i 

Time is probably the most frequently overlooked incidental factor in 
system performance. Designs that ignore the effect of delays in system 
response on user acceptance or performance are implicitly assuming that 
such effects do not exist. Rest assured, they do. Short delays-for example 
when a user types a letter and nothing appears immediately on the 
display-can convince the user that the system has not seen an input 
Delays as short as a quarter-second can lead users to make repeated inputs 
The repeated input leads in turn to errors (a double letter where a single 
letter was intended) or to wasted resources (two requests for recovery of data 
when only one was desired). Longer delays can lead to user -frustration 

Most frustrating of all are delays of random duration. One moment 
the user receives almost instantaneous service and the next moment the 
user must wait for what seems to be an eternity. Variable delays are 
generally the result of variations in load. Instant response is available 
when a single user is present, but delays become noticeable as more users 
attempt simultaneous use of system resources. In a well-designed system 
loading effects should not be perceptible for rapid sequential operations 
(such as typing the separate letters of a name) and should be minimal for 
major operations (such as , he de , ay between initia , ing a , itle ^ 
first seeing the results of that search). Response time for rapid sequential 
operations should always be shorter than the time it would take a touch- 
typist to repeat a missed key (about 0.1 to 0.2 seconds). Response time ( time 
elapsed to the beginning of responses) for more Pengthy instructions 
should be a small fraction of the time taken to specify the operation, and 
should never exceed about three seconds. Note that it isonly necessary that 
the response begin within that time. 



The Fallacy of Human Homogeneity 

Finally, the battle may not be won even if a system provides excellent 
interactive prompting for a naive user. The needs of a new user are rarely 
the same as the needs of an experienced user. Interactive prompts that are a 
necessity for a new user may be a frustrating waste of time for an expe- 
rienced worker who is using the terminal extensively. As a further compli- 
cation, the type of display device in a terminal may affect people's 
acceptance of instructions which are superfluous to their needs The 
relatively slow output rate of a printing terminal, for example, can be 
particularly exasperating if most of the printing consists of instructions 
the user does not need. The same instructions on a video display might be 
perfectly acceptable since the rapid rate of display would outweigh the fact 
that some of the instructions were superfluous. 
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Figure 3. User capabilities usually change with time and experience. 

Design of human-machine interactions must, in short, take into con- 
sidcration the needs of the novice user (who will require aid at every step), 
the experienced occasional user(who will need minimal prompting), and 
the experienced user with a substantial workload (who will be mostly 
interested in rapid response and minimal hindrance in getting the job 
done) These three levels of experience are frequently telescoped in time for 
" a Riven individual who sits down at a terminal as a novice and stands up 
(several hours later) as an accomplished user. The well-designed system 
must accommodate all of these levels of expertise by an appropriate ma- 
ture of optional paths, self-selected "help" sequences, and careful human 
engineering. The human engineering must, above all,. minimize idiosyn- 
cratic forms of interactions that simplify the work of a computer pro- 
grammer at the expense of the convenience of users. 
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Conclusion , 

This paper has concentrated on viewpoints rather than details of 
technique for two reasons. Firsj, the physical design of systems is rapidly 
changing as new components become available. For example, a few years 
ago it would have been reasonable to list theadvantages and disadvantages 
t of making the application characteristics of a particular system hardware- 
' resident rather than software-resident (e.g.,_a keyboard designed for a 
specific application v. a general keyboard with software prompts) 
Changes in types of memory and display devices available are now blur- 
ring such distinctions. In general, specific suggestions about system con- 

change ^ S ' mPly d ° " a8 °" ° f rapid technolo S ical 

Second, our experience has shown that the real source of problems in 
most design efforts has been failure to identify clearly the goal-Tand 
procedures that define the system. In the absence of clear goals, computer- 
design specialists must substitute their own view of what is intended or' 
needed. To the extent that these specialists have specific experience in the 
practical problems of a given application, their views may lead to success- 
ful designs. To the extent that these specialists rely on the fallacies des- 
cribed here, the designs may be dramatically unsuccessful. As in any 
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change in work procedures, there is a need for direct, active input by those 
who have experienced the reality of the task environment. When the 
chanee in work procedures requires investments in time and money of the 
magnitude demanded by selection or development of computer systems, 
that need becomes crucial. 

The fallacies of system design-described here can be averted most easily 
by continual, careful cooperation between design specialists and those 
who are thoroughly familiar with the ultimate application of the system. 
More than in any other form of computer system design, systems that 
provide interactive terminals for occasional use by minimally trained 
persons demand careful design to insure that expected performance occurs 
under realistic conditions. Systems that make unrealistic demands on user 
training, memory, or ability will not.be truly successful even though they 
may function under ideal conditions. 
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Introduction 

Many libraries are in the processor closing their card catalogs and replac- 
ing them with microform or on-line catalogs. This change in catalog 
format in turn requires several important changes in catalog generation 
and support: (1 ) all cataloging data must be recorded in machine-readable 
form; (2) different equipment must be used, e.g., terminals are needed 
instead of typewriters, and microform readers or computer terminals are 
needed instead of card catalog cabinets; (3) the sorting sequence must 
change from a manual filing-rules sequence to a machine-generated sort- 
ing sequence; (4) staff must be trained both in the procedures to create 
machine-readable records and in the use of the catalog format; and (5) 
patrons must be taught to use the new catalog format. 

It is the change in equipment needed in libraries that is dealt with in 
this paper, specifically, determining the number of terminals required for 
an on-line catalog. The change in catalog access equipment, from card 
catalog cabinets to microform readers or computer terminals, means a 
major change in the method of access to the contents of the cataldg. 
Currently, only one complete card catalog set is needed for normal catalog 
traffic in any one location. Since the card file is divided ?nto many discrete 
access units (file drawers), patrons rarely have to wait for access to the 
desired section of the catalog, even at peak periods. With microform 
readers and terminals, however, the entire catalog is available through one 
single equipment item, and access is suduhat only one person at a time 
can enter the catalog through that piece of equipment. Therefore, multiple 
microform copies of the catalog or multiple terminals are required to serve 
multiple users. } s 
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To house the new catalog format, large equipment purchases are 
likely to be necessary. Thus, budgeting and planning become major man- 
agement concerns. Sufficient equipment must be purchased to assure 
prompt user access, even during peak use periods. Yet, expensive terminals 
and readers should not sit idle for long intervals during slow use periods. 

Background of the Study 

In assessing equipment needs for the conversion to an on-line catalog, 
• the Dallas Public Library initiated a study of current catalog use, with 
plans to incorporate the findings from the investigation into its design and 
planning process. This investigation was limited by the available data. 
The data collected on current card catalog use were.analyzed and used to 
project equipment requirements for an on-line catalog. Usage levels and 
patterns for the new catalog were assumed identical to those of the present 
card catalog. While there will be significant changes in both. level and 
' patterns of catalog use with the implementation of an on-line catalog, 
until such changes can be quantified there js no way to incorporate them 

into the study. ...... ,u 

Dallas Public Library is a large metropolitan library system with a 
central library and seventeen branches (plus an eighteenth under construc- 
tion) with an annual circulation of 4 million items, and with holdings of 
95 million volumes. The- library has been automating its services, in 
stages since 1971. "When completed, the total automated system will 
include- an on-line, optical character recognition (OCR)-based circulation 
system that will post circulation status information to theon-hnecatalog; 
a library materials acquisition and accounting system; and a film-booking 
system All program development and equipment support has been done 
hy the City of Dallas Data Services Department. As of early 1980, th6 
automated circulation sysiem is operational with an on-line delinquent 
patron file, an on-linefjirculation statistics subsystem, and a batch transac- 
tion card check-out, check-in system. Much of the circulation system pre- 
sently in use has been operational since 1 973. The on-line catalog has been 
operational and publicly accessible with partial holdings since February 
1978 rhe catalog contains fixed-length, non-M ARC records of all central 
library monographic holdings, plus branch library holdings added since 
February 1978. Retrospective, conversion of branch library holdings is 
expected to be complete in 1982. , 

The on-line catalog was made available to ail library agencies in' 
February 1978 through the circulation system terminals located behind 
circulation desks in all branches and the central library. When initially 
implemented, the on-line catalog could be searched by author, title, 
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™'torAitle combination, or call number (Dewey Decimal system). In late 
1979, a subject search based on Library of Congress Classification subject 
headings was added. Starting in mid- 1978, additional CRT terminals were 
provided in public service areas' to be exclusively used for access to the 
on-line catalog. By early 1980, every Dallas Public Library branch had at 
least two terminals, one in.thcpublicserviceareaandonein the workroom 
for rctrospeeiivc conversion of holdings. Additional terminals for public 
sen-ice usage .will be added throughout the 1980/81 and 1981/82 fisnl 
years. 

The next major proj-ct will be completion of the circulation system ' 
upgrading it toa full on-lincsystcm with a patron databaseand links to the 
on-line catalog, so that circulation status information can be posted to 
catalog records. The first stage in design of the acquisitions system has 
been completed, but no programming has yet been done on that system 
Lhe fiUmbooking system will be the last projec. to be completed The' 
central library will movt to a new, much larger downtown facility in 198-> 
and the on-line catalog and circulation system will be operational when 
the new building opens. 

Strategy of the Study 

Early in the planning stages for the automated systems, the need for i 
fairlv precise estimate of equipment requirements became appaient H,e 
investigation-was initiated by soliciting opinions from the public service 
librarians in the branch libraries and the central library. Their opinions 
showed great variance, so a scientific approach was sought. 

Aware that other libraries had already made deconversion to micro- 
form and on-lme catalogs, the study team decided to survey other libraries 
to learn the means used to determine the number of pieces of equipment 
required. We were not able • identify other public libraries that had 
already converted to on-line catalogs, so the survey was restricted to public 
libraries which had converted to microform catalogs. Because microform 
ai d on-line catalogs both require one station per concurrent user we 
assumed that the quantity of equipment required for each would be' the 
same. We were aware tha- there are qualitative differences between micro- 
form and on-hiK- catalogs, but no data were available to indicate the effect 
that these differences would have on the number of stations required We 
chose to make the assumption of equality, unless some useful data fqr 
distinguishing between microform and on-line equipment needs were 
later discovered. 

For the purposes of a mail survey, lists of microform catalog users were 
obtained frou microform catalog vendors. The survey was restricted to 
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pubtic libraries witl^niaoform catalogs. The results of the unpublished 
survey were in<x>nclusiv&for the purpose of obtaining quantitative data on 
how the^number of microiorm readers was determined. Libraries generally 
said the number was.dettfmined by "guesstimate," or by /'buying as many 
as we could with the moW^^Me." One library stated, "the more we 
buy, the more they get used." The 6nly quantitative formula given was one 
from a study done by Butler, West ari^iAmie}^ A brief review of the project 
and formula are given by Aveney anTtJhikSs. 3 

As neither the informal internal survey ndi the mail survey provided 
the needed data, the Dallas Public Library decided to do itsown study. The 
study was based on card catalog usage systemwide, sampling both traffic at 
the catalogs arid the duration of the search time at the catalogs. The library 
hoped, to gather enough data to determine the number of terminals 
required both to maximize equipment usage and to minimize patron 

waiting time. % 
It was not practical to do.a detailed traffic study at each of the library s 
catalogs. The Dallas Public Library has a large number of card catalogs. 
The central library has a union catalog for the library system, plus individ- 
ual catalogs for each of four subject divisions. Each of the seventeen 
branches has,at least one card catalog (combined adult and youth hold- 
ings); most have separate catalogs for adult and youth materials. There- 
fore, representative catalogs were chosen for the study, based on collection 
size and rate of circulation. The main union catalog was included in the 
study as it is unique in the system, and one of the four subject division 
catalogs was selected to represent those four catalogs. Blanches were 
divided, by holdings and circulation, into three classes: large, medium and 
small. Two branches were selected from each of the three classes. The 
following catalogs were chosen for study: 

Central Library: 

Central library main catalog. This is the union catalog for the Dallas 
Public Library system. 

History and Social Sciences catalog: This catalog contains records for 
the 109,000 volumes held by this division of the central library. 

Large Branches: 

' Audeha Road Branch catalogs. This branch holds 84,250 volumes and 
* has an annual circulation of 345,000 items. 

f -Park Forest Branch catalogs: This branch holds 71,000 volumes and 
has an annual circulation of 304,750 items. 

Medium Branches: 

, x Lakewood Branch catalogs: This branch holds 65,200 volumes and 
\ has an annual circulation of 247,750 items. 
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Hampton-Illinois Branch catalogs: This branch holds 66,000 volumes 
and has an annual circulation of 240,750 items. 




/ 



Figure I. Traffic at the Catalog 
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Oaklawn Branch catalogs: This branch holds 29,500 volumes and 
has an annual circulation of 97,000 items. 

Thedata were collected during one week in May 1978. Twodifferent types 
two different sets of data collection forms "(see figs 1 and 2) " 

nJ Ta! l iC % tke Catal ° g - ReC ° rds w - erc ke P l of how many people used the 
catalog, by 15-minute periods of the day. Data were collectedlb^oneL" 

tZZ 1 *? WCek: u a fU " m ° ming ' fu " aftCTnoon ' and <»" evening wrre 
covered during the week, although not all fell on the same day One 
complete Saturday also was covered. Breaking up the dayThis way wa 
necessary, as only the central library is actually o£n morning afTemo^n 
and evening on a single day. Central library hours are 9 !m -TpT 

w°:t y t r :;f Friday> an ^ 9 am - 6 pm - s *^- - 

10 a.m -6 p.m some weekdays and 12 p.m.-9 p.m. on others pIusIO 
the scheduling of personnel to do the data collection 

part of the study: 10a.m.-I1 a .m. (slow period). 3:30 p.m.-5:30 p m (peak 
period), and 7 P.M.-8 p.m. (peak period). During these three time £ £? 
each person going to the catalog was clocked in and clocked out. Sis 
done by jotting down brief descriptive notes about the person on th da'a 
collection form to keep track of all individuals using [he catalog . 

The data from each study were further subdivided by patron and staff 
usage at ^ central library (both the main catalog and the History and 

fe.alSc^esca.loglandbyadultandyou.hcaiusageat.S 
libraries. The latter subdivision was necessary as some of thf bra nche have 

2S e ^ f0r K adu i tand ? outh holdi ^- ^e division was made by 
catalog, rather than by individual; that is. a patror. at the youth catalog was 
considered "youth" regardless of the person's age. The division^™ 
and staff was at the request of the central library staff, and was kept for its 
own usage. Because the total data collection was small for staff a nS youth 
those data were not aggregated. Day of the week, time of day, and location 
distinctions were made in the final data analysis. * 
. Data collection was done both'by Dallas Public Library staff and by 
library volunteers. A total of oVer200 individuals were invoked in thedata 
MiZn,"* L,brary f voIun | ccrs »™ very cooperative and some helped in 
different agencies from those in which they normally volunteered We 

SKS? M f K Ct th3t "° Uld * ^ represent the entir 

Dallas Public Library system, so that assistance given at any agency would 
benefit other agencies within the library system. ' 

The data were manually tabulated by the library staff, showine oat- 
terns of usage and averages by time of day. Some correction to the da ta on 



30 



TERMINALS FOR AN ON-LINE CATALOG 



27 



number of staff inquiries was made for the central main card catalog, based 
on usage of the on-line catalog terminal. At the time of the study, that was 
the only location that provided readily -available access to the on-line 
catalog. No similar corrections were made in the branch library data 

collection. - 

The original intent of the study was to do further data analysis using 
queueing theory. It was found that thedata manipulation required was too 
complex to perform manually, and that City of Dallas computer time was 
not readily available for the task. Copies of all of the raw data collection 
sheets therefore, were provided to Neal Kaske of the OCLC, Inc., Research 
' Department in June 1979 for analysis by computer, using queueing algo- 
rithms. The analysis which follows is a result of the work done at OCLC. 

Data Analysts 

The OCLC Research Department used a multiserver queueing model 
to analyze the data collected by the Dallas Public Library. This model 
assumes a common stream of patron traffic, a finite number of identical 
servers (terminals or readers), a common waiting line when all servers are 
busy anda "first-in, first-out" selection from the waiting line. The partic- 
ular multiserver model used was adapted from a model documented in the 
IBM publication. Analysis of Some Queueing Models in Real-Time Sys- 
tems* A graphic representation of this multiserver queue is shown in 
figure 3. 
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Figure 3. Model of Multiserver Queue 
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The first step of -data analysis was to convert the tallies from the 
Duration of Search Time" forms (fig. 2) to machine-readable, format, 
pnly complete data records (containing both a starting and ending time) 
were converted Computer programs were then written to process these 
, records and calculate the following*values: 
mean service time (T.) 
mean interarrival time (T,)* 
traffic intensity (Ti) 

Traffic intensity is defined as 
T, = T. 
T. 

and represents the amount of system capacity in demandat any given time 
Oie records were processed in sets by location, date and time of day. Then' 
a traffic intensity (Ti) value was calculated for each set 

Once traffic intensity was calculated, thedata were tested todetermine 
if they fit a Poisson distribution. If the da ta did fit the Poisson distribution 
(which they did when analyzed by hour blocks of catalog use), standard 
queueing formulas could be used to calculate the mean waiting line and 
ume for a given number of servers at low, average and peak catalog use 
Tables 1 and2 report traffic intensity values and traffic parameters for the«e 
three levels of catalog use. The parameters computed were: (1 ) the proba- 
bility that a patron will find a reader/ terminai idle; (2) the mean length of 
the line of patrons waiting to use a reader/terminal;and(3) the mean time 
a patron will need to wait in line for a reader/terminal. Each of the 
parameters was calculated for one to eight servers for the catalog. 

To make the data useful for Dallas Public Library management, a set 
of decision rules was eslablished for use with the data. The decision rules 
were. (l) the patron must finda terminal/readeravailable90percentof the 
time; (2) there must be no waiting line for a terminal (on average less than 
one patron in line at any given time); and (&) the patron must wait in line 
thirty seconds or less. The effects of thesedecision rules are shown in lableS 
To enhance the usefulness of the data for library management a 
sensitivity analysis was conducted. The sensitivity analysis provided a 
range of values for the measure of congestion (traffic intensity). For the 
analysis, the derived values for traffic intensity were doubled and halved 
and the same three decision rules were applied to the values. The results for 
doubled am halved values are shown in tables 4 and 5, respectively The 
problem of determining the number of terminals required is thus bounded 
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TABLE 1 

TRAFFfc Intensity Values and Traffic Parameters-Central Library 
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P=the probability that a patron will find a trader/terminal idle 

L=thc mean length ot the line of patrons watting to use a reader/terminal 

W=the « SSfr (in fractional minutes) a patron will need to wait in line for a reader/terminal 
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• . TABLE 2 

Traffic Intens.ty Values and Traff.c Parameters-Branch Librar; 
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TABLES-. 

Decision Table Showing Effects of Decision Rules 



_ Large Branches 
Audclia Road 
Park Forest 

Medium Branches 
Hampton-Illinois 
Lakcwood 

Small Branches 
Lancaslcr'Kiest 
Oaklawn 

Central Library 
Main Catalog 
History k Social Science* 



Number of Servers Needed 
To assure patron will find a To assure fewer than one user 
terminal reader free 90% in at any givm H 

of the time 
Peak Average Peak 



•1 
3 

6 
3 



2 
2 

I 

2 



To assure users wait m line 
K-minute or less 



Peak 




5 
3 
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-i 



Average 
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3 
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TABLE 4 

Decision Table for Traffic Intensity Doubled 



To assure patron will find a 
terminal/reader free 90% 
of the time 
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TABLE 5 

Decision Table for Traffic Intensity Reduced by Half 



Large ^Branches 
Auddia Road 
Par* Forest 

Medium Brunches 

Hampton-Illinois 

LakewrxxJ 
Small Branches 

l-anruster-KicM 

GaMawn 

Central Library 
iflain Catalog 
History g: Social Srienm 



To awair patron will find a 
terminal/ reader free 90% 
of the time 



Number of Senders-Needed 
To assure fewer than one user 
in line at any given time 



To assure ttsers wait in line 
%-minute or less • 
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Summary 

The data collected for this study represented actuar usage levels and 
patterns f9r specific agencies of the Dallas Public Library system. The data 
analysis detennined how many terminals were required to support the 
same levels and patterns of usage for the on-line catalog that were evident 
for the card catalog. There are two limitations to this study: 

1. The results of the data analysis are specifically applicable to the Dallas 
Public Library; a direct extrapolation of the data to other libraries, 
based on figures-such as circulation, traffic, and holdings, may not be 
. legitimate. 

2. The usage of an on-line catalog will not be the same as the usage of a 
~ card catalog. On-line catalogs ar.e not limited to all terminals being in 

one location, in the manner that all drawers of a card catalog must be in 
one location. Therefore, terminals may be scattered throughout the 
library, or in other buildings. More or less time per search may be 
required for the catalog with an on-line terminal. The card catalog 
(with the exception of the central library main catalog) contains records 
only for the library agency in which it is located; the on-line catalog, 
however, will be a union catalog for the library system, which will affect 
usage patterns. If printers are available for the terminals, users will print 
out the desired records rather than spending timeat the catalog copying 
them. These changes in usage patterns are only the ones that are now 
anticipated, and it is expected that other changes will occur. 
While the limitations to the study are significant, it is still a quantita- 
tive step forward. The early investigations showed that libraries have been 
guessing at th»amount of equipment needed, without havingany quanti- 
tative figures to support their guesses. The figures for terminal require- 
ments obtained from this study provide a starting point for equipment 
purchase. Adjustments can be made from this point based on actual usage 
The data obtained from the stud> show that in most cases, fewer terminals 
are required than were originally thought. In one case, there may be as 
many as five fewer terminals required to meet peak usage than the Dallas 
Public Library staff had originally estimated. 

The Dallas Public Library is using this study to support the budget 
request for terminals in support of the on-line catalog. The library consid- 
ers the results to be useful management information, and planning deci- 
sions will be made accordingly. 
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University of Guclph 
Guelph, Ontario 



Public Access at the 
University of Guelph Library 



Introdurtion 

The University of Guel ph is one of fifteen provincially a ssisted uni versi ties * 
in Ontario. Guelph is a medium-sized institution with 10,000 students 
(1000 of whom are graduate), approximately sixty miles northwest of 
Toronto. Although it received its charter in 1964, the university was based 
on the integration of three existing agricultural and veterinary colleges 
which date to the middle of the last century. 

This changed university status and the formation of'four new col leges 
led to the need for immediate acquisition of thousands of monographs, 
documents and serials. Automated cataloging systems were seen as the only 
solution to the organization, access and • processing problems which 
resulted By 1967 the University of Guelph Library staff had designed ana 
implemented separate automated systems for the cataloging and process- 
ing of government publications, monographs and serials, and a retrospec- 
tive conversigffof the original college catalogs was completed by 1968. 

The ce#al library building on the Guelph campus, the McLaughlin 
Library which opened in 1968, now houses 1 .5 million volumes in 
square feet. One of the design criteria for the, building was automated 
circulation control, so that automated circulation became an important 
subset of the Guelph cataloging system, extracting necessary data elements 
from the Guelph master, file of bibliographic records. 



Previous Batch Circulation System b 

This basic circulation system, using punched book cards and patron 
badges, served Guelph reasonably well from 1968 until 1976; circulation 



38 MARGARET BECKMAN 

transaction lists were printed daily, and overdue and fine notices, error and 
edit checklists, and management reports were produced as' required A 
simple system to handle reserve book circulation was added in 1973 The 
data collection terminals were changed in 1972 from IBM 1030s to Colo- 
rado Instruments (later Mohawk) C-DEKs, but the original concept of the 
system was not altered. 

Reasons for the Change From Off-line to On-line System 

By 1976 the pressure on the library was considerably greater with 
10,000 students than it had been when the building opened for 3000 
students in 1968. For instance, in 1976-77 some 500,000 books and docu- 
ments circulated, while in-library use was double that amount. In addi- 
tion, the climateofeconomicrestraint that influenced Ontario universities 
demanded strategies that would reduce or at least hold constant the exist- 
ing library positions. Knowledge of changing technology led to considera- 
tion of an on-line circulation system early in 1976, and a study was 
mounted to identify specific problems or inadequacies of the existing 
batch circulation system, and to specify design requirements for a new 
on-line system. The following inadequacies were identified. 

Mechanical breakdown. As a result of the transaction load mentioned 
above, the percentage of errors present in the circulation system increased 
greatly during 1975 and 1976. This was primarily due to mechanical 
breakdowns in the C-DEK terminals, which were no longer being manu- 
factured or supported by Mohawk. Each incident of terminal breakdown 
increased the possibility of incorrect data being recorded. 

Errors The C-DEK terminal used a very unsophisticated method to 
prevent the acceptance of incorrect data (double punch and blank column 
^ detection allowing errors to creep into the system without detection Staff 
errors also contributed to mistakes in the overdue and fine notices pro- 
duced by the circulation system, creating unnecessary friction between 
library staff and users In addition, students in increasing numbers had 
discovered ways to subvert the system, complicating the errors which the 
breakdowns and staff were causing. 

In constrast, current technology for data collection uses bar-coded 
labels, with an error potential of one in 200,000 reads. This rate can be 
further reduced by a 10 percent chance of the error matching a correct 
record; thus, the net theoretical error possibility is one in 2 million. It was 
felt that adoption of such a system at Guelph would not only eliminate 
^ errors but would also stop thesubvertingof the system by patrons, since the 
labels arc manufa^.ured in such a way that any attempt to remove the>^ 
results in thei. destruction. 
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Cost and inefficiency. The library circulation staff had developed a ' 
series of checks and counter-checks to compensate for errors present m the 
off-line system. These checks were very time-consuming and expensive 
and put an unnecessary load on an already overburdened staff. The cost of 
this checking was estimated at $13i500 annually. 

Another area in which inefficiencies were evident was the library s 
holds procedure. Thrt-is^tt-atthe most critical procedures performed in 
the library, requiring manual checking of approximately 1 million books 
reshelved each year. This checking was done for the most part by student 
pages, and the fact that they were part-time and that so many persons were 
involved magnified the chances for error. Hold requests increased by an 
average of 50 percent per year from 1972. a veraging-4000 requests in the fall 
and winter semesters of 1975/76. " .... 

It was concluded that an on-line system would eliminate the necessity 
for this manual checking routine at a savings qf over $9000 in staff time 
annually. In addition, another area of user dissattsfaction would be 
removed, since the capture of items requested by patrons would be facili- 
tated at the circulation point, before books reached the shelves dr were 
chareed from the library. 

Kesense desk. Use of the reserve book system had increased almost 30 
'oercerXt per vear from the time the^library opened in 1968. stretch. ng the 
ojpacitv of the simple semi-automated system to its limits. It was realized 
,haT a more sophisticated system was necessary, not only to maintain 
efficient service to the students without adding staff, but also to provide the 
management information necessary to ensure that the reserve service was 
' beine responsive to theneeds of the teaching program. 

In summary, the study concluded that benefits from conversion to an 
on-line circulation system would occur primarily in three are^s: data 
accuracy, human error reduction, and more effective use of staff. 



Design Criteria 

In establishing the design criteria for an on-line circulation system, 
the University of Guelph Library looked beyond the basic functional 
requirements of circulation. We envisaged the capability of a single ^library 
system, albeit consisting of not necessarily compatible units, with direct 
access by staff and users alike. We also wanted a system which would have 
adequate backup procedures and be responsive, at minimum cost, to 
changing requirements within our own library system. 

Based on the early experience with our first circulation system, we 
emphasized the importance of the relationship between the circulation 
sy s rem and the catalog. The continuance of that relationship was consid- 
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T d w£ rin,5 7 i "lP° rtance - which "leant that the circulation records 
should be a subset of the catalog data base in the Guelph system 

Our previous involvement with a bibliographic utility-centered sys 
tern, the University ofToronto Library Automation System (UTLAS) also 
influenced the design criteria. For two years we had participated in me 
on-line cataloging system at UTLAS. with our catalog records stored on 
the central system in Toronto.. We had found ourselves locked into an 
mflex.ble system that responded to needs perceived to be common to the 
Hi n l " 0t neCeSSa " ly J?**** *P«*to requirements of the individual 
^S'^ZSr™: ' "rculadon and acquisition systems linked 

to the centra cataloging system but able to respond adequately to local 
needs and polices were not encouraged. After two years of expensive and 
frustrating experience, we returned to our iVfiouse systems, determined to 
remam independent for local processing and to purchase needeTbiblfo 
graph. data fiom uuht.es if and when necessary. These philosophical 
des.gn requirements may be expressed in greater detail. The system must: 

1. operate on an in-house minicomputer with adequate backup proce- 
dures to ensure continuous operation; 

2. provide capability for direct use by the students and faculty, minimizing 
the involvement of library staff in routine inquiry procedures- 

3. provide capability for on-line catalog inquiry as part of the circulation 
system; 

4. be able to interface with other components of the library system pro- 
vidmg an integrated and responsive total library operation- and' 

o. provide capability for linking with on-line circulation systems and/or 
catalogs operating in other Ontario university libraries. 

These five requirements were most influential in making the final 
selecqon of an appropriate system, since no existing on-line circulation 
system seemed to encompass either the philosophy of power which the 
Guelph requirements demanded. Essential would be a minicomputer 
capable of sorting and processing all Guelph files of machine-readable 
SncludeT CtiVe0f rec0rdformatorfilcsiz K In 1977 thoGuelph library 

monographs including audiovisual materials (films, tapes, etc.)cataloged 
in a MARC-compatible format— 400,000 records- * 

government publications coded using the Guelph Documentation System 
which assigns each document a unique.jurisdirtion-based document 
number— 270.000 records; 

maP L COd ^ ™ '°fi! y dC4i8n ° d SyStCm with a Sophie map num- 
bcr— oO.OOO recdrds; 

serials which do noi orculate but which are wanted for display ir any 
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catalog inquiry system. Guelph serials are classified by the Library of 
Congress system, and individual issue holdings would need to be 
displayed for inquiry and management information purposes— 
10,000 records. 

In addition, capability for storing MARC files on-line was considered a 
requirement for both cataloging and acquisitions functions, and assumed 
a high priority. 

With all design criteria included in a specification document, we 
received tenders from a variety of vendors. We chose a joint development 
proposal from a Canadian company, GEAC, because it most closely met 
our design criteria and would allow us to implement our system philos- 
ophy. We felt strongly that a system designed with the involvement of 
Guelph library staff would allow modifications and changes by that staff 
with relatively little difficulty, particularly since minicomputer technol- 
ogy was involve!. We also felt that without an integrated on-line system, 
we could not make the anticipated staff reductions without reducingdirect 
services to the user. 



System Design 
File Design 

Although an efficient on-line circulation system was the primary 
objectiveof the design phase, the need for coordination with the cataloging 
acquisition, serials, and documents systems was an essential aspect of the 
Guelph design philosophy. For this reason, the design phase began with a 
study of file structures in bibliographic processing systems in use else- 
where in North America or Europe. Without hindering the circulation 
function, we hoped to be able to provide integrated access to all the Guelph 
records in their varying formats, without the necessity of actual conversion 
to a common record structure. t> 

This objective was met by adopting a method for structuring the files 
for internal processing similar to that of the DOBIS system, implemented 
at Dortmund, West Germany, in 1976. This concept disperses t^e various 
data elements of each record to different files, and links them with keys, 
pointers and/ or indexes. Thus, personal names from the monograph file, 
which has a MARC-like structure, are held in the same file as personal 
names from the, Guelph document file, with its simple documentation 
* structure, When displayed on the terminal, names from both files are 
shown together. If a user or staff member wants to see a complete record, a 
simple instruction pulls the record together. The call number or document 
number related to a name (or title, or other data element) reveals to the user 
whether he is looking at a record for, a monograph, document, etc. It 
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should be apparent that an authority system is inherent 'in the system, 
[f - P n ^ :lud,ngtheex P ensivenecessit y of creating and maintaining a separate 

; Public Inquiry . 

| The second key criterion in the system design was that of public 

) inquiry or use of the system. University of Guelph Library experience with 

j : retrieval systems such as CAN/OLE (Canadian On-Line Enquiry), Lock- 

: heed and SDC (System Development Corp.) had indicated that the staff's 

| roleas intermediaries was a necessary part of the service. It was agreed that 

{ a circulation system which depended on library staff to interpret or assist in 

; access to the Guelph data bases for monographs, serials, documents, and 

• maps, or to files of circulation and reserve system transaction information 

' • ' wou Wnot be appropriate ih an environment of financial restraint, 
i . . u , ,n( l u,r y module of the circulation system was designed, therefore 

; with self-instructing display screens which lead naturally or sequentially 

from one command, instruction or question to another. Each set of func- 
tions is displayed as a "menu" from which the user selects the key desired 
After locating a wanted title (book or document), the user can move to 
another set of functions which allows him to determine the location, status 
and/or loan period for the book, and to place a hold on it if it is in 
circulation. He may also inquire about his own borrowing record— 
whether he has books out, when they are due, amount of fines (if any 
owing), etc. 

If the student or faculty member becomes confused at any point in his 
use of the inquiry terminal; a simpleaction returns him to the first "menu" 
or display, which begins the step-by-step instructions again. The actual 
us^r functions are described in more detail later. 

Operating System 

The GEAC 8000 operating system facilitates the processing of biblio- 
graphic information by allowing complete variability of field and record 
« structures. AH fields in the records are bit-aligned, which means that only 

that number of bits required to store a particular data element is used. This 
fact, coupled with the use of advanced data compression techniques 
allows not only efficient data storage but also high performance on the 
terminals. A very rapid response, which is essential for on-line inquiry, is 
possible because the volume of data transferred in a "mini" is much less 
than in conventional main-frame' computer systems. 

Further efficiencies are achieved through the file structure, where only 
as much data as are necessary to differentiate records are stored in any index 
entry. The data base management system of the GEAC also contributes to 
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the essential efficiency of a public on-line system. All data in the system are 
Led in what GEACdefinesas wrapped files. The data definition foreach 
Ssstoredinwhatiscallttlawrappedtable.Thistechniqueprovidesan 

additional level of data security in that a file in the wrapped state cannot be 
used on any other computer. Data would appear in this instance as a long 
string of bits. This technique further assists in data management in that a 
field can be moBfled in size or changed in definition simply by changing 
the tables in ib3%swtapped table. The next time the file is updated, the 
change will ha^e-been»«»mplished. , 

UGLI the GEAC processing language, is not only a language but also 
has facilities within it to provide for data base management and the 
application processers. There are two different operational levels, one for 
staff and one for patrons. The patron may query the system and perform 
certain functions, but cannot add data. The staff member may query the 
svstem and add or modify data as well as process them. < ...... 

The maintenance processers produce andaccept tapes, provide defini- 
tions, create and modify data, and reorganize files. The system creates new 
records but docs not discard old records. 

Description of User Menus 

Each terminal in the system offers a selection of functions which can 
be performed. These are displayed on the CRT in a "menu. Ihc com- 
mand fonnat is a numeric one, and the display itself indicates to the user 
how to select a desired function from the menu and how to proceed with 
each subsequent step or procedure. 



System Operation, 1977-80 

TOe system just described became operational in September 1977. after 
two months of parallel testing. We began with twenty-six terminals, 
including six available for public use. The first semester of use was a 
traumatic experience, for three reasons. 

1 We operated without a fail-soft mechanism, i.e., a backup computer, 
' and experienced a variety of problems. For example a major thunder- 
storm knocked out our power supply. Asa result, we installed a separate 

2 PoUdesw iegulations that we had built into the system, such as refusal 
to lend a book if a user owed more than a $5 fine, proved too inflexible 
on weekends since no staff could collect the money. We had to program 
?n a series of overrides to compensate for hours when only student 
assistants were on duty. 6 
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S " Z'JSZZ a h ntici f te ' he f nt |\ usiastic res P° n! * «o the public terminals, 
; S£S?SSSC lT aband ° ned ^ and Hned U P at six 

\ In January 1978 our main computer, the GEAC 8000, arrived and we 
transferred our existing library computer, a GEAC 800 on which we tad 

input for all other library systems to the new GEAC 8000, so that the 800 
was ^ways available as a backup for circulation. This mSnnhat anS 

S£l«r r l °^ e m t SyS ' Cm asdeve, °P-en t ofenhancemen o n w 
modules continued, with no impact on the public circulation functions 
The positive user reaction cannot be overemphasized. Aside from 
including ,he on-hne inquiry system in the regular library orienta l 
program, as well as a brochure and publicity campaign no soedal S 
ing was given. We depended on thedispla/to iJS^SSS^Z 
this proved quite successful. The terminals are located near reader se'rvice 
desks, so that durmg most hours the library is open, staff are wSSE 
student is having difficulty "wanding" his badge ava "*ble if a 

Admittedly,, we had a less enthusiastic response from many faculty 
members who were resistant to "computers" as a matter of principle We 
.mvued all,facu.«y to come to special seminars, either indivrtua ly or I 

a portable terminal. The ease and simplicity of the system soon converted 
most opponents, and we have had to do few individual faculty £EJ 

Changes and Improvements 

fall 197 n 7 "? ^ diSC ° V " ed dUfing the initial hectic se ™s«er in ' 

fall 1977 was that students, m particular, learned how to manipulate the 
system very q ul ckly. and grew impatient with the screen sequence By he 

GEAC8 n oO0 ^Vh h " ^ C ° nCUrrem with "--itch to h 

GEAC 8000 we had developed "Version II" of the system. Primarily this 

go°ng dttr to g f le f USeMO ^ m ° re qUkk ^ thr °^ h < h « 
"?NTORM» LI T° U S ° Ught - We als ° added additional 

INFORM messages, so that more than 100 informational messaees 
could be received via the terminal. We improved the filing arrangement 
changed the display of the call number, and responded to other coSent 
user suggestions for the public inquiry mode. consistent 
In addition .to doubling the number of terminals available for public 
SS-li? T' WC decentralized in fall 1979 by linking the 

GEAC 8000 to the campus Gandalf network. This made the on* ne 
■nquiry system available on any of the standard ASCII terminals on cam- 
pus allowing a read-only capability of accessing the library file. Response 
tothisoption. which we call "remote access, "has also been enthusia dTln 
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addition it creates many more potential services, such as remote placing of 
holds o ^putting purchase requests. These functions await further test- 
ing oi I'emote-access module, and the development of adequate secunty 
for remote entry to the system. 



Conclusions 

Although this has been, of necessity, a" brief description of almost three 
vears' experLce with public access at the University of Guelph, we have 
CLd Zny inclusions about the potential for this service, and the 
implications for library operations in the next decade. 

Library users, particularly students, adapt very quick y to a compute 
terminal system and are ableTd cope successfully with quite sophisticated 
user functions. In 1979 agroupof fourth-year computer science students at 
The university did an analysis of the circulation andcatalog inquiry system 
£ the hE and concluded that we needed, in addition to more term., 
nal the dt e display increased from three to five per screen, and tale 
Sword sea h strategies combined with subject as a basic key ' (The latter 
w plan to do after the present catalog system is completely converted to the 

^WeTo'anticipate little need for any increase in our orientation 
oroeram even with the increased sophistication of functions available. 
?2 Compute" assisted instruction which the sequential menus obviously 
^PplyTe^ms to be the best orientation we could provide. Incdentally, the 

novice user. We may be_able to eliminate these in a few years. 

Cmnlne Access— Card, COM or On-line , 

ln\t I current controversy over catalog format, the University o 
ruelnh Library has no doubt at all that, for a variety of reasons, there is 
S one way 7o go: on-line. We have had complete COM/fiche catalogs 
uispcSd throughout the library as a supplement to the card catalog since 
197? Although they have been used and have some advantages, they 
cannot Place the card catalog in their currency. Support for this view 
Smes from a recent study at the University of Oregon,' which concluded 
Z mSTtudents simply will not use multiple files, and a library cannot 
S r r 0 merge L frequently enough to offset this problem, or to 
nrnvide the immediate access of the card catalog, 
^e^rne catalog allows the user to relinquish dependence on ^he 
main-entry-centered card catalog, with its emphasis on standardization. If 
^Tn ramputer system (such as that described) allows integration m one 
acTess meThod of records of differing .ormats, then it is possible to provide 
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the depth and method of bibliographic description required for each 
resource forma, This is different for books, maps serials, document and 
archives. Admitted y, the bibliographic utilities are enshrining the coh 
cept of standardized in-depth record formats for all materials. In th long 
run, however this is an expensive disservice to the local library us* 
Know edge o other library holdings, now accessible from the union data 
base of the utilities, can be less expensively available through adistrltd 

The on- line catalog also bypasses AACR2 and all its related problems 
An opportunity is now before North American libraries to rethfokThe 
purpqse of the catalog, and to use automation to respond to use 
requirements. , ~ *^ uscr 

Terminal Numbers and Type 

In addition to commenting on menu and screen formats the studenr 
group mentioned earlier also determined the number an7d?s; dbutfon o 
public terminals which, based on observation of both card atX and 
on-hne inquiry use, they felt the library should have. The Sbranf 111 
estimated the need for an additional seven teiminals (see tab e 0 Th«e 
estimates indicate that the total number of library term nais requ ed for a 
university of approximately 10.000 students is between twenty t ^nd 



~ TABLE 1 

Number and Distribution of Public Terminals 



Location Stud „ u Estimate 



Lxbtar) Estimate 



Documentation center 2 

Reserve room 2 ^ 

Science division 4 ^ 

Veterinary science division - 1 



Social science division 9 2 

Humanities division 3 ' 

Card catalog (former) area g ^ 

23 30 



Total 



The library is also considering dedicating at least two terminals to 
borrower file inquiry only. With this arrangement, students wTm re y 
want to know if they have books overdue do not need to I inX7with 
students wanting catalog access. 

1™ I* T 301 ? thC remote - ac «ss terminals, some of which will be 
located In the student residences, may well influence the decisions abom 
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numbers and locations of in-library terminals. Althoug h many more i ter- 
minals are already on order, a final, decision will be made before May 1981 , 
when we remove the card catalog. 

'Menu Drive v. Command Operations 

It has been suggested that it is more efficient in terms of internal 
computeroperation to havea command-driven rather thanamenu-dmen 
system While this may be true in theory, minicomputer technology makes 
the issue unimportant. Experience with a command-driven system elimi- 
nates it from consideration as a public tool. Cost of training sessions air' • 
procedural manuals for staff more than offset the slight benefits which 
might accrue from a "more efficient" operating system. Again, the quick 
response possible in on-line minicomputer technology allows the menu- 

• driven system, with alternative options for new or experienced users, to 
operate without the necessity of library staff intervention or assistance. 

On-line Access for All Systems . 

The potentials of on-line public inquiry or access in an academic ( 
library areVremendous. As indicated earlier, different levels of bibliograph- 
ic access with different record formats for different materials, r,n all be 
accommodated; so can "on order" information from the acquisitions 
system or periodical arrival information from the serial check-in system. 

• Libra™ or campus information, e.g., library hours, borrowing regula- 
" lions, campus activities, or exam timetables, could form another data base 

that would be accessible on-line, making the library the focal point for all 
information on the campus-a position perhaps sought at present, but not 
-necessarily achieved. 

^TnZcccm article in the Journal of Academic Librauanship, Leonard 
suggested that- "we are not capitalizing upon computer technology s 
potential to enhance service to library users....Automation [in improving 
the efficiency of production of the manual card catalog] has been used to 
enhance technical productivity and not user access."' Experience _ with 
on-line publicaccess and user inquiry at the University of Guelph Library 
demonstrates a different and desirable direction for the use of computers in 
libraries one which abandons concentration on catalog formats and rules 
of entry, and adopts as its primary objective improved service to the library 



user. 
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A Study of the Measurement of 
User Performance 



This paper reports on an attempt to measure the performance of users of 
interactive information retrieval systems. 1 The subjects studied were end 
users of the information who were doing their own interactive searches. 
The measures consist of a set of computerized diagnostic procedures ap- 
plied to the sequences of commands used in querying the database These 
diagnostics trigger various kinds of messages to the user. Presumably the 
frequency with which a diagnostic is triggered is an index of the difficulties 
which the user may be having in doing a search. Although the utility to the 
user of the information retrieved is assumed to be the best overall measure 
of search outcome, it is the manner of using the system, not the search 
outcome, which is the focus of this report. 

The studies described here were part of a larger project called Individ- 
ualized Instruction for Data Access (IIDA). The goal of this project has 
been to provide a method for allowing direct user access to bibliographic 
searching Thus, the attempt has been to develop a set of computer soft- 
ware packages which can provide on-line assistance to occasional users 
This collection of programs is also intended to provide ' nst ™ ctl °"> ll 
needed, in the commands used in searching and search strategy. When 
originally conceived, the expected utility of IIDA lay in the area of what 
might be referred to a. "problem-solving searches." These are searches 
where the end user of the information does not know exactly what the 
- - characteristics are of the desired set of references until they have actually 
been found. Consequently, it is .very difficult for the user to describe the 
problem to an intermediary. There is no reason, however why the IIDA 
, user could not and should not make use of the system for all kinds of 
searches, if desired. 
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One intended I IIDA user ,s a working scientist or engineer who may 
rteed access to the database only a few times a year, and consequently is noi 
interested in training oriented toward those who become professional 
mtermedianes. This person fs assumed to becomfortable using computed 
but not necessarily trained, in their use. In addition, it is as* Jr ned that this 
user is a serious, well-intentioned searcher, who is trying to use the system 
to soke a problem. The IIDA software and diagnostif procedures ; were 
created to help remove the barriers- to access for these users. Minor modifi- 
cauons ,.f the system, howtver, couldmake it available to a much wider 



' DESCRIPTION OF IIDA 

Physical Configuration "~ 

A schematic of the current physical arrangement of the IIDA system 
appears in figure 1. While it is now possible to package the IIDA software 
in a dedicated minicomputer, the experimental versio., of the IIDA soft- 
ware resided in a generai-purpose, time-shared computer at the Massachu- 

with Twt° [ TcCh " 0l r-, An IIDA 31 3 te ™ inal communis 
' hc MIT computer which houses the IIDA software. This computer 
also houses the CONIT software, developed by Marcus and Reinties 
which performs some vital functions for the IIDA software. 2 When actively 

T^v'SS ^ C ° nnCCtC ? with DIALOG through either TELENET 
or I YMNET. The user employs the DIALOG language, and receives 
standard DIALOG responses. IIDA adds additional infemaiio^anSfc" 

n,A?nV f P ° tiCS ' b,U d0CS not offcr a » alternative to using the 
DIALOG language. For the Undies reported here, the database used was 

™Tr*M^° Ut ^ Iimemal work of various kinds has also made use of 
ERIC, NTIS and ONTAP ERIC A detailed description of the IIDA 
software can be found in an IIDA report and in Toliver. 3 

User Introduction to IIDA 

One of IIDA s design principles \vas to make its use as much hke the 
direct use of DIALOG as possible, except when the user needs help. After 
logging on, the user is offered a brief, optional introduction to IIDA 
which if accepted, provides a summary description of the system and of the 
available IIDA services. The user is also told how to ask for help and how to 
quit at any time. 

While interacting with IIDA and the database, the user docs so in 
either of two modes: instruction or assistance. In the assistance mode, 
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Figure 1. Schematic of IIDA physical arrangement 



described, later, the user begins searching, enters a series of DIALOG 
commands, and receives the same responses as he would without IIDA, if 
the commands are syntactically valid or do not trigger any of the diagnostic 
messages. If the user is not previously trained or desires a refresher course, 
he might begin with one of the computer-assisted training courses in the 
instruction mode. 



Instruction Mode 

The three exercises which constitute the instruction mode were 
designed to provide the user with: (1) the basic information necessary to do 
a search, (2) an opportunity to test these skills in a hands-on searching 
context/and (3) an opportunity to be exposed to advanced training in 
search commands and' search strategy I While the user is allowed to begin 
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use of IIDA at any point, and to proceed in any order, the recommended 
path for the novice is to do the three instructional exercises, in order, before 
going into the assistance mode. 

"Canned" Search 

In the first exercise, the user is introduced to the basic commands of 
DIALOG-BEGIN, SELECT, EXPAND, COMBINE, PAGE, TYPE, 
LOGOFF— through the medium of a "canned" search. The user is 
instructed to enter the commands which are given to him (i.e., he does not 
choose them; he is told, for example, to enter BEGIN 8). Then he sees a 
"DIALOG response to the command, and the command is then explained. 
The intent is to maximize self-discovery. All of the commands are used in 
the context of an actual search, and so are used in the wav they might be in a 
"real" search situation. In addition to this exposure to search commands 
and search strategy, the user is also introduced to the concept of a two-cycle 
search. A two-cycle search is, basically , one in which the user creates a set of 
references, and then, based on set size, browsing, or even intuition, cycles 
back to refine that set. 

The user at this stage is also provided an introduction to the IIDA 
• help" facilities These facilities enable a user to get: (1) the definitions of 
search commands. (2) advice on current problems. (3) information about 
commands given in the current search. ( 1) a list of thesets created up to the 
point at which help is requested, (5) a summary of therecoTds v iewed up to 
the point at which help is requested. (6) a list of the errors made. <7)a list of 
the descriptors used, and (8) instruction on how tochange from the present 
exercise or mode to anothei. A more detailed description of this and the 
other instructional exercises ran be found in an IIDA report. 4 

Practice Search 

The second exercise is a practice search in which the novice user is 
asked to try out the use of some of the things learned in the first exercise. 
The user is also introduced to goal setting in scare hing. in that he is asked 
to set a search goal for a specific number of citations. Th.re is no stipula- 
tion that he actually meet this goal, but sev eral of the diagnostic messages 
that he might receive refer to it. 

During exercise one. the computer is not connet ted to DIALOG, and 
the search which is done always produces the same results, since the 
information is stored in IIDA. During exercise two. the IIDA computer is 
linked with DIALOG, and the search performed is completely under the 
control of the user Normally, it is expected that, only the commands to 
which the user has been introduced will be encountered in this exercise, but 
there is no restriction on usable DIALOG commands. Similarly. IIDA 
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suggests to the user some sample topics for searching in this exercise, but 
the user is free to search any desired topic. Those topics suggested to the 
user are generally simple ones for which there is a relatively high probabil- 
ity that the .user will be able to do a successful search. An early success is 
desired to provide the satisfaction of-seeing the system workcoirectly and 
productively. 

Reference Walk 

The third exercise in the instruction mode consists of a required look 
at summary descriptions of the available advanced instructional materials 
with the option for self-directed advanced training. These options are 
illustrated in figures 2 and 3. The contexts of this exercise include: (l)a 
review of the basic commands, (2) information about advanced commands, 
(3) an introduction to text searching, (4) further information about search 
strategy, (5) database description(s), (6) information about beginning and 
ending, and (7) a discussion of the IIDA facilities. As illustrated in figure2. 
the user is introduced at a general level to topics on which considerably 
more detailed information is also available. Once this introduction is 
completed, users have a choice: they can either go on\o the assistance 
mode, or return to do self-selected adv anced training in v arious portions of 
e\ercise three (see fig. 3). 







Figure 2. Reference walk in exercise three 
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Figure 3. Self-selected advanced training in exercise three 



Assistance Mode , 

In the assistance mode, the searcher performs his own search. The 
purpose of IIDA in the assistance mode is to offer assistance, to enable the 
user to do a search in DIALOG with.a minimum of difficultv and interrup- 
tion Besides actually doing a search in the assistance mode, the user can, at 
any time, leave the search and enter any of the instructional exercises, or 
start the search over AUhough it has not in fact been tested, irtprinciple'the 
user should be able, if patient enough, to do a search by going directly to 
the assistance mode without first using the three exercises in the instruc- 
tion mode. 

The three major features of the assistance mode, in" addition to the 
flexibility it offe*s the user, are: (1) the reference help library, (2) quick 
advice, and (3) the set of diagnostics which monitor searcher behavior. As 
shown in figure 4, the reference help library contains all the information of 
exercise three in the instruction mode, but here the user is allowed free 
access to any information in the x library at any level of detail selected. In 
addition, IIDA will also provide quick advice. Quick advice involves 
suggestions to the user on how to proceed in problem situations. In some 
cases, the nature of the problem is onambiguous, and IIDA can reference a 
particular bit of information in the help library. In other cases, the sugges- 
"tion may simply be to use' the help library. Once the desired information 
has been obtained, the user cansignaJ for an auiomatic return to the search. 
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Pigure 4. Free access to the reference help libiary during assisted searching 

* 

The most important aspect of the assistance mode, however, is the set 
of diagnostics which monitor searcher behavior and offer advice to the 
user. These diagnostics consist of a set of rules,.clustered into categories, 
which are used by the computer to decide which messages to send ro the 
user. Thus, IIDA is prir wily a reactive system^-the diagnostics are used to 
detect errors or tendencies which may lead to problems. If a diagnostic 
routine detects a problem, IIDA intrudes on the user with a statement of 
what the problem appears tabe, and an indication of how to get advice or 
reference information. 

DIAGNOSTIC PROCEDURES ^ 
\ I — / 
Once a search begins, the user enters a series of QIALOGcommands 
and receives the same responses as he would without TDA, if the com- 
mands are syntactically valid. However, each command x nd its DIALOG 
response are intercepted by IIDA, parsed, and the components analyzed by 
the diagnostic procedures. If errors are discovered, IIDA intrudes into the 
communication between the user and DIALOG. In the case of a straight- 
forward syntax error, the command is rejected (as it would be by DIALOG), 
onH a specific statement of the problem is given the user. 
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The term error is used guaidedly for other diagnostic procedures, since 
the nature of the problem is not one susceptible to.algorithmic solution. 
Except for syntax errors, it is not possible to be entirely certain that a given 
command is "wrong/' This judgment requires a knowledge of the goal 
and intentions of the user within a completely closed or bounded problem 
in which it is possible to specify all actions as either "right" or "wrong" on 
the basis of a set of well-defined rules. In this case, "wrong" and "error" are 
relative, since the diagnostics operate on the basis of certain heuristic 
principles/Thus, the diagnostic routines are intended to identify various 
behavior patterns which might lead to, or already be, a problem. The 
diagnostic messages are generally words of advice or caution to a user. 
They identify a problem or potential problem, and offer the user access to 
advice or instruction specific to that problem. The user is completely free 
to assume he knows what is going on, v and to continue doing whatever 
triggered the diagnostic message. Given the open and unbounded nature of 
the problem involved, it may well be that the more experienced user knows 
exactly what he is doing. 

Design Principles 

The IIDA diagnostic system was based on the following principles; 

1 The diagnostics have no access to any information about a searrh other 

than the search history; that is, IIDA can have no prior knowledge of 

how a given search "should" be performed. 
2. Hence, IIDA is reactive\it helps a user decide how to proceed, given his 

performance to a point. Irdoes not initiate directions in the sense of 

tellhig the user how to proceed with the search. 
3 Diagnostics analyze user commands "and the search service's response to 

them, determine problems, and point generally toward solutions. 
Emphasis is on encouraging self-discovery of solutions, e.g., when an 
error is detected, IIDA will suggest where advice or instruction is avail- 
able, but wjll not force it on the user. 
4. In making up the messages to be sent to tfie user, there was a conflict 
between the desire to offer the fullest explanation of any error (or 
apparent error) and the desire to avoid distracting the user by too much 
verbiage The choice made was that all messages to the user reporting on 
error conditions shouid be as short as possible. Further, they should be. 
unemotional It is particularly important to avoid a conversational tone 
which users might interpret as pejorative ("You are wrong"), patroniz- 
ing ("Good for you"), or cute ("Well, [name cf user], you seem to have 
done this before"). This decision arose both from the designers' expe- 
riences with other systems which became abrasive quickly, and from the 
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belief that serious users will be content with straight information and 
will derive satisfaction from task accomplishment with a minimum of 
"chatter." • . 

5.- Certain errors must be brought to the user's attention each time they 
occur. For example, a syntactic error in formulating a command must 
be corrected if the command is to be executed. Othef types of errorsneed 
be brought to the user's attention ooly if repeated often. This leads to the 
need for thresholds, suppression and enhancement. 

For some errors, a threshold may be established allowing the error to 
be repeated a certain number of times before it is brought to the user's 
attention. In this case, the error message is suppressed until the thresh- 
old is reached. Once the threshold is reached, the message is sent, the 
index is reset, and when the new value is exceeded, a stronger or 
enhanced riiessage may be sent to the user. 

6 IIDA diagnostics do not, except indirectly, assist in the selection of 
appropriate search terms. Use of DIALOG'S dictionary is stressed in the 
instructional material. Failure to use the EXPAND command (which 
searches the dictionary) may result in a diagnostic message, but IIDA 
does not suggest what actual terms to use. a < 

7. Throughout the design of IIDA diagnostics, the intent was to focus the 
user's attention on the concept lhat a search is a structure to be designed 
and executed as a whole. At the same time, the user's easy access to help 
should relieve anxiety about mechanical detail by assuring him that 
forgotten details can easily be retrieved. 

IIDA Concept of a Search 

Conventionally, a DIALOG search'starts with a BEGIN command 
and progresses through EXPANDS and SELECTS to one or more COM- 
BINES, and then to TYf>E or DISPLAY. 5 After browsing, a user typically 
goes back through one or more of the commands— EXPAND, SELECT. 
COMBINE— and then browses again. Each excursion through EXPAND, 
SELECT, COMBINE, and TYPE, even if not al) of these commands are 
used, constitutes a cycle. A sequence of commands of the same type consti- 
tutes' a string. A cycle, then, consists of one or more strings, each of which 
consists of one or more commands of a given type This is illustrated in 
figure 5, where, strings of length one, two and three are shown, and these 
form two cycles. The second cycle begins when, following a TYPE com* 
mand, the user reverts to SELECT. A number of the IIDA diagnostic 
procedures make use of this concept of strings and cycles. 
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Figure 5. Strings and cycles in a search 
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Classes of Terms 

The diagnostic procedures fall into the following three broad classes: 

1. Syntactic. A DIALOG command m.iy be viewed either as a simple 
sentence consisting of a verb and (usually) a noun phrase, or as a 
compound word. It is conventional computer science terminology to 
refer to the governing structural rules as syntax, although morphology 
may be more accurate, since a command lies somewhere between a 
compound word and a sentence. At any rate, the first classof diagnostics 
is concerned with the validity of a command, and this consideration is 
entirely context-free. The guiding operational rule is that a command is 
valid if and only if it would be accepted by DIALOG. 

2. Individual command usage. Given a command that satisfies context- 
free stiuctural rules, there may yet be problems that range from fatal 
errors (such as the use of an- undefined set number in a COMBINE 
command) to mere inelegance of usage (such as repeating a previous 
command). The context of the analysis is limited. The diagnostics in 
this class consider the most recent command in the context of the 

6 2 



MEASUREMENT OF USER PERFORMANCE 



accumulated history of previous commands. In a sense/this form of 
analysis is syntactic.in that it is more or less analogous to analysis of 
sentence structure in natural language. 

Command string us«g<.-Command string diagnostics are concerned 
with a set of commands as an entity, rather than -with individual 
commands. These diagnostics are, in effect, concerned more with style 
than with mechanical exactitude. 



Diagnostic Subclasses 

In addition to performing diagnostic functions, the syntactic diagnos- 
tics are also an inseparable part of the IIDA command and response 
parsers which maintain the history of the search and interact with com- 
munications control software. The nonsyntactic diagnostic procedures 
are however, implemented as a series of rules, not unlike rules in a formal 
decision table. 6 Below, the diagnostics are described in terms of subclasses 
of diagnostics which represent groups of rules. The actual statement of the 
rules is very much dependent upon the specific data base and search service 
used, while these subclasses remain fairly general. 
1 Syntactic. All syntactic diagnostics begin with a left-to-right scan of the x 
' command text. If an unacceptable element is detected, the user is 
informed of what part of the command text is acceptable and at what 
point it becomes unacceptable. A response is made to all syntax errois. 
2. Individual commands. These diagnostics consider a single command in 
the context of previous search history. 

a Repeated commands. In DIALOG searching, in general, repeating a 
command with its argument is wasted motion. There are exceptions to 
this such as if the searcher is working at a CRT terminal and does not 
have a printed record of his previous work, or if he wishes to use ! the 
PAGE or DISPLAY SETS commands. But to repeat a SELEC I , COM- 
BINE or TYPE generally is an indication of careless work. Further, 
IIDA can recognize what we call essential repetition, which is a repeti- 
tion of the logical essence of a command without it being exacUythe 
same command (e.g., COMBINE ) • 2 is logically equivalent to COM- 
BINE 2 • I). A single instance of a command repetition fault is not 

& Null sets. Generally, a null set resulting from a SELECT commands 
an indication of poor choice of terms. If it results from a COMBINE 
command, it may represent no more than an infelicitous choice of 
Boolean expression. Null sets created with, the SELECT command 
indicate that the user should take some steps,! probably thesaurus brows- 
ing to find better terms. Nulls created with the COMBINE command 
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simply indicate the need for a different choice Of expression. Repeated 
.mil set errors are assumed to be serious, and positive steps should he 
taken when they occur. 

c Unused sets. Sets are "used" when they are referred to in commands 
such as COMBINE or TYPE. If sets in any appreciable numbe^e 
being created but never used in later commands, the assumption is that 
they are perhaps ,11 considered. This may be an indication of thrashing 
. i.e.. the rapid change of direction of searching. HDA counts the number 
of unused setstreaied in each cycle, but comments to the user only when 
after a q-cle, the number of unused sets is greater than it was at the end of 
the prevrow cycle, indicating a possible trend toward creating an 
increasing numb er of sets never used. Null sets are not charged to the 
unused set count. This is considered to be a moderately serious problem 

d. Prmt format. There are two types of print control errors. The first is 

■ irrDIAi°nrf that ' S "^'y tobeuninformativ e- The extreme case here 
n a DIALOG format which gives accession numbers only, and is of no 
help to a searcher for browsing purposes. This is an example of a 
problem which might not occur often, but could unnerve a user when it 
docs happen. 

e. Excessive printing. The second type of print control error involves 
excessive printing. Novice users -often print excessive numbers of 
records on-hne because they are not used to sampling. They do not 
know . use of the off-line print commands, and they may be unaware 

°1T, C Z\ In J ,d A diti u 0n, thC CX ' 3crimental "DA system terminals ope.- 
a ted a 300 baud. At this speed, economy of time was important because 
of the limited number of hours during theday when theresearch studies 
could be conducted. Consequently, it was necessary to limit thenumber 
of citations a user could print with a singlecommand. This limit va.ied 
with the format used. 

f. Response time. The time between a machine's message and the 
input of the next command by the user is measured. Excessive consump- 
t.on of tune is, of course, expensive, and isalso an indication of searcher 
difficulty, n addition to its pedagogical value, the time measurement 
can be used (p terminate a user's session if the delay is extreme, indica- 
ting that the person has probably left the terminal but has not logged 
off. rime is not critical tosearch logic, but longdelays inhibit theextent 
to winch/a person can remember all he has done previously Time in 
early experimental wo.k, has been found a good discriminator between 
experienced and inexperienced searchers. 7 

Strmg diagnostics. These are the diagnostics that look at sequences of 
commands. ^ , 1 

a. String and cycle length] Vests are made for length of a string, by type 
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of string, and for length of a cycle. The basic assumption is that any 
unusually long segment of a search might be an indication of a user 

r«g. This is changing the "direction" of a search rapidly or 
often, without pursuing any given direction far enough to see if it can 
work out Searcher motivation for thrashing might be overly easy dis- 
couragementwith preliminary results, such as getting a null set or an 
extremely large set from one search, formulation; rather than trying to 
modify that formulation, the user turns to a completely different 
approach. At its worst, thrashing is indicative of random, uncontrolled 
behavior It is, of course, not possible to measure "direction" precisely. 
It is done in somewhat arbitrary fashion by taking a measure of the 
similarity of the Boolean expressions in successive COMBINE com- 
mands One consequence of this is that thrashing can occur only within 
a string of COMBINEs.~The measure, called the similarity index, is 
made up from the percentage of implied terms common to the two 
expressions. "Implied" here means that an expression is expanded by 
replacing set numbers with their defining terms, and then the similarity 
count is done on term?, not set numbers. IIDA computes the number of 
terms in common, divides that fir* by the number of terms in one 
expression then by the number in the other, and then takes the mean. 
This gives thesimilarity index between any twoCOMBINEcommands. 
Thrashing is a mildly serious problem. A little bit of it does no particu- 
lar harm. A great deal of it indicates a searcher is in trouble, 
c Dwelling. This is behavior opposite to thrashing. It is lemaining 
with a search concept when it may be time to give up and try another 
approach. As with thrashing, dwelling is defined only within a string of 
COMBINES. Thesimilarity index is used to recognize dwelling, but this 
lime it is in cases of similar COMBINE expressions, rather than dissimi- 
lar that an IIDA message is sent to the user. Also used is the concept of 
convergence or divergence. The searcher will have been asked at the 
beginning of an IIDA-mediated search to state the search goal as a 
numeric step function. If a string of similar COMBINES shows progress 
toward that goal, there is less concern about dwelling; if there is progress 
away from the goal, but the user remains with the same basic seaich 
concepts as indicated by the similarity index, he is dwelling. Regardless 
of convergence or divergence, if a similar string is too long the user is 
dwelling Dwelling can be a serious fault in that it might indicate a lack 
•of understanding on the part of the searcher as to what a mechanical 
search; performed by someone of his sk ill level, is capable of producing. 
Perhaps the best example is a case in which the database simply does not 
have much information on the subject sought. Excessive dwelling does 
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not help much; the problem is to realize the meagerness of the lode. 
u Relevance Much has been written about the nature of relevance, all 
of which . , sidestepped in UM relevance in this context is a judgment 
made by a searcher about the value of search result? to him. There is no 
way to control how he thinks about the concept, and there is no diver- 
s.onary teaching on the subject. IIDA does ask the searcher to make a 

SiJEmS? 3fter , each P? tin S of a "*°rd (using the command 
TYPL or DISPLAY), unless the display was done using format 1 (which 
shows only accession-number). The judgment is made on a five-point 
scale, from irrelevant to highly relevant, with representing "irrele- 
vant. Diagnostics are performed on the average relevance figures for a 
group of records displayed with a single command, as long as at least 
three records are typed. Relevance diagnostics are not based upon faults 
orsearch errors, but they are used todirect thesearcher's attention tothe 
fact that a particular set seems not to be fruitful, or that a previously 
exammcd set yielded higher relevance scores. Although low average 
relevance figu.es give no hint as to the remedy, the problem detected is a 
serious one-the searcher has come to the end of a cycle and is dissatis- 
fied with the results according to his own definition of relevance If this 
condition rectus lepeatedly at tlvend of cycles, the entire approach to 
the search comes into question. 



TESTING 



I he testing of the diagnostics as a way of assessing user performance 
necessarily involves the testing of users as well. There have been essentially 
three majo. phase- of this testing. These consisted of the pilot testing of the 
entire system to ensure that it functioned as intended, a baseline or bench, 
mark study conducted to establish a set of reference points for the operation 
of thediagnost.es, and a training method study done to deteimme whether 
the diagnostics operate diffeiently with people trained in differing ways. 

Pilot Testing 

The pilot testing conducted with IIDA was oriented primarily tow ud 
the d.scoveiy of either programming or conceptual problems with the 
operation of the system. Among the groups working with the system 
during this early testing were undergraduateeomputer science majors who 
acted as users and who were challenged to find the problems. In addition a 
number of facility and graduate students from DrexePs School of Library 
and Information Science were invyed to review theoperation of the system 
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and give their advice and comments. All of the members of this latter group 
were trained searchers, and some of them are regularly involved in the 
training of searchers. Another pilot test group consisted of a number of 
• undergraduate engineering majors, who did the search .training as ipartofa 
course on technical writing. The experiences and feedback of each of these 
user groups resulted in successive changes and refinements in the opera- 
tion of the system. For example, extensive cross-comparison of the search 
transcripts from the technical writing students and the records kept by 
HDA provided a check which ensured that the machine record-keeping 
programs did what they were programmed to do. 

This kind of pilot testing is an indispensable part of the development 
of anv system as large and complex, and as user-oriented, as HDA. Because 
of their closeness to the system and the problems of conceptual design, the 
system designeis aie at times not the best judges of what material should be 
viewed by. or must be explained to, the user. The following examples,, 
which were easily corrected by revision of user instructions or of the 
instructional material, illustrate this point well. Even though their initial 
classrexnn description of HDA was of a computer system that would assist 
them in retrieving refeienees foi use in w.iting required course-papers, a 
few of the technical writing students started the training initially expect- 
,„ e to retrieve facts about the ir scare h topic rathe, than . eferences relevant 
to the topic. Other students did not seem to reali/e that the commands 
encountered in exercise one should be learned for future use. Another 
problem which showed up in the early stages of naming the technical . 
writing students involved theeffectsol sea.ch commands ,n thecontex. of a 
search' The version of exercise one used with these students illustrated a 
search on the topic of library automation. At one point ... tins search, the 
user was told to EXPAND LIBRARY. A few of the users subsequently 
thoughrthat the next tune they wanted to EXPAND a term, they weie to 
enter EXPAND LIBRARY, no matter what term was to lx- expanded. 

Baseline Study 

The baseline studv was conducted in 1979 at the Exxon Research and 
Egnmeering Company facility at Florham Park. New Je.sey. I he study 
design called for collecting data on the searches performed by twen.y-.ve 
searchers who were trained and assisted by HDA. In adda.on. twenty- .ve 
comparable searches were to be done by the information retr.eval staff on 
site Tne intent here was to use the intermediated sea.ches to prov.de a 
profile of diagnostic usage for comparison with the diagnoses usage of 
he HDA users. It was anticipated that signifieant d.fferences between the 
t wo groups of searches would reveal deficiencies in the HDA tra.n.ng and 
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Procedure 



JVlicipaim in this study consisted of fifty Exxon txLar'ch enemas 
employed ar the Florham Park site who had been recruited b{ Zl 
Approximately. 2200 letters were sen, out offering the opportunity for 
techmcal personnel to do on-line searching on their own via the IDA 
system Approximately 150 responses were received. The names el an 

the deparunent and section would no, be considerations for participation 
u, thestudy. Front tins randomized list, twenty-five participants Sbn 
random y assigned to the IIDA training group, and twenty-ute wef" 
randomly assigned to the intermediated group 

two ^oTT T' 8 ""! l °J h l " DA traini "g W -re scheduled for 

«h? IT 1 f " DA traini '^ f ° ,lowed b V <™ IIDA- 
assisted I searches on top.es of then own choosing. Each of these partici- 
pant filled out a post-search questionnaire aftef completing the second 
search. Participants assigned ,„ the intermediated group bfought their 
next search topic to one of the Information Center staff, asvthey would 

SSTt M i^mf" ' h ° WCVCr ' W3S fi ° nC by thc to ««w««iy '"rough 
aspects of IIDA working for the intermediated searches were the .ecord- 
keeping functions, which kept track of the search history and of the 

E^frT 4 - VanOUS 1 dia « n f tic ™'« «™ Jiggered by the sea.ching 
bchauo, of the intermediary. A post-search questionnaire was given to 
each of the participants ,„ the intermediated group, along with the results 
of the search request*!. Sin, , y had ^ bruited l.th an offTol 
sea.cn training, these particip*nti were scheduled for IIDA search tiainme 
after completing the post-search c]tiestionnaiie. 

Resit Its 

The f x>st-search questionnaire for participants in both the IIDA and 
the imenrtechated groups included a question which asked what percent- 
age of the reference,, e.rieved were: (1, very useful. (2) useful, ^useless 
For purposes of analys.s, the -very useful" and "useful" categories * -re 
combined mto the single categon. "useful." The difference between the 
hvo groups <,„ this measure was not significant (Mann-Whitney V Test n 
> (Mb), with the IIDA-trained group reporting an average of 52.5 percent 
useful references, and the intermediated group ,n average of 19.3 percen 
useful references retrieved. Consequently, i, appears that the results of the 
searches were va lued equal ly hy those who did their own searches and those 
who had a search done for them. 
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Turning to the diagnostics, the patternisone in which there appear to 
be JSSwtei^" the two sets of search*. The mean frequence 

Sories of diagnostics contained within each major catego.y. 
„ figh, of the intent s f this study, i.e., to prov de a set of d.agnosnc 
bench mark criteria against which to assess the performance of he D - 
' rained -uui assisted searcheis, it was surprising to discover a Jack 01 
en k,n dif ences between the two groups of searches. A significant 
di^nce o, one or more of the diagnostics would have pointed toward 
« d rficiena- in the HDA training, or in the usefulness of the diagnostic 
messa^ dur,ng IIDA-assisted searching. This would have led to revision 
I W Shipecis of the svstcni. The finding of no significant differ- 
" ££££ ^.problem in that this could suggest either, hat the 
mV M S »8 and HDA diagnostics work well, or that they are totally 
"tv n. O e ason for argling that the training and diagnostic assist- 
worked as intended is that the end user evaluation of ; the u .hty of the 
Z inn retrieved in the searches did not differ significantly between 
STlT^^s means that a g.oup of individuals who had never . 
tZ dcL on-line searching were able, with HDA training and ass.s- 
uTce to do searches which produced remits containing as much useful 
Sma ton as contained in searches done by professional sea.rH rs 
I nde"these circumstances, the notion that thediagnost.es are irrelevant as 
measures of searcher performance seems implausib e. , 

U should be mentioned in passing that there ., one subcategory o 
rf ia J,osdc i formation which is not included in the results repotted .» 
SreTsit^h intermediaries did their searches with HDA suppressed 
£1 „o, asked by the system to make relevance judgments on he 
erences tvped out. Consequently, this diagnostic category was no 
i„cE in the data of the HDA users when comparisons were conducted 
between the IIDA-assisted and rhe intermediated seaiches. 

Training Method Study 

The second major test of HDA and the diagnostics took place at the 

Fxxon Research and Engineering Company facility ,n Linden, New Je - 
ey during the winter months of 1979-80. This study involved a compar - 
on of he searches done by HDA-trained and assisted searchers with those 
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done by a group of searcher's who were also assisted by IIDA, but who had 
been trained in a half-day classroom training session. The intent of this 
study was to test the instructional procedures and materials inv Q lved in 
IIDA training against a more frequentl> used and conventional traming 
method Presumably a human instructor is more responsive to the prob- 
lems which a student may' encounter, and presumably the student has a 
greater range of questions which can be asked, of a human instructor, 
especially since IIDA is not designed to be a question-answering system. 
Consequently, it was anticipated thr.t significant differences between the 
two groups of searchers would meal deficiencies in the IIDA training, 
which.'Vould subsequent be corrected b> appropriate modifications of 
the system. 

Procedure . 

Participants in this stud\ were primarily research chemists and other 
scientists. Participants * ere again recruited by mail, with letters sent to the 
entire research staff describing the opportunity for bibliographic search 
training and asking for volunteers. As with the earlier study, about IdO 
responses were received. From the list of volunteers, fifty were randomly- 
selected to participate. Twenty -five volunteers were randomly assigned to 
receive IIDA training and then do two IIDA-assisted searches, while the 
other twenty -five w ere ass.gned to the conventional training sessions, with 
two IIDA-assisted searches following training. All participants in the 
conventionally trained group received training by Exxon Information 
Center staff in one of four morning sessions. AH of the training sessions 
used thesaiWtrammg materials (handouts, etc.). covered the same mate- 
rial, and allowed some on-line time for. the users to practice what thev had 
learned., 

Result.% , 
In this study , the poM-search questionnaire, which was administered 
after completion of the second IIDA-assisted search, asked the user to 
decide what i>ercentage of the references retrieved had been: ( 1 ) very useful. 
H useful. (3) useless. Again, the first two categories were combined into 
the single category "useful." The difference between the two groups, 
while apparently large, was not significant (Mann-Whitney 1' lest. |> > 
0.05) with the'IIDA-trained group reporting an average of 16 6perccnt and 
the conventionally trained group an average of 62.9 jx-rcent useful refer- 
ences retrieved. ' 

Concerning the diagnostics, again there appear to be no difference 
between the twp ^et S of searches. Th* mean frequencies for each group of 
se- ches for each of the three major categories of diagnostics are illustrated 
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in figure 7. It should be noted that the data in this study do include the 
subcategory of relevance diagnostics in the "global- diagnostics, since 
both groups d.d their search with IIDA fully operational rather than 
supposed (as was the caseTor the intermediated searches done in the study 
described earlier). For each of the three categories of diagnosticTihe 
differences between the two sets of searches are not statistically significant 
(Mann-Whitney IT«UP>4). Furthermore, individual comparLZI " 
the subcategories of diagnostics fndicated no. significant differences 
between the two groups. 

Considering that the purpose of the study was to compare IIDA 
training with a more conventional method, the lack of significant differ- 
ences between the two groups was surprising. A significant difference on 
one or more diagnostic measures would have indicated either a flaw in the 
IIDA training materials or in the diagnostic messages during assisted 
searching. The result would be a revamping of one or both parts of the 
svstem. Since no significant differences were discovered, there is-the prob- 
lem of interpreting the results, except for the fact that thegroups were able 
to retrieve a significant percentage of useful references during their 
searches. Presumably this 5 represents something which neither group 
would have been able to accomplish if simply turned loose with a terminal 
without any training. Further, the two groups did not.differ in their 
estimates of the percentage of useful references retrieved. This pattern of 
results argues strongly that IIDA training, as it Is presently structured 
represents a viable alternative to the type of conventional training with 
which it was compared. » 

looking at the data from both studies and comparing both sites bv 
diagnostic category, there were no significant differences in the usage of 
thediagnostics frome one site to the other. In addition, judgments made by 
users about the percentage of useful references retrieved did not differ 
significantly from one site to the other. Thus, the ?So groups trained at 
Linden did not produce results appreciably different from those obtained 
for the group of intermediated searches done at Florham Park. It should 
also be mentioned that the variability in the measures, including percent- 
age of useful references retrieved, did not differ significantly from one 
group to another. One final point to be noted is that the users seemed to 
like IIDA Approximately 90 percent of the users, either trained and 
-ssiMcd bv IIDA or ,ust assisted by IIDA. said the> would recommend use of 
IIDA to their friends. 
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DISCUSSION AND CONCLUSIONS 

« 

User Performance 

It is not possible to separate completely the performance of the IIDA 
diagnostics from the performance of the IIDA users. Focusing first on the 
users, however, the data suggest that IIDA users did searches which were 
on two kinds of measures, done as well as those done-by a professional 
searcher. First, in the ratings of the utility of the overall results of the' 
searches, there was no significant difference between the results obtained 
by the professional searcher and thoseobtained by theuserperforminghis 
own search. Second, no significant differences were found in the number of 
IIDA-detected errors or faults between the newly trained, IIDA-assisted 
searchers and the professional searchers. Together, these findings imply 
that the resultsof thesearching wereabout equal, and that the performance 
ol the searchers was about equal. 

It was initially a surprise to find that the error/fault rate seemed about 
equal between the professional and neophyte searchers. IIDA was designed 
to produce acceptable results for its users, but it was nevei expected thai the 
step-by-step performance would match that of professionals. There are 
however some muigating circumstances which may have handicapped 
the professionals somewhat. For example, the -Exxon professional 
searchers are used to working with 1200-baud terminals. With these termi- 
nals more on-hne typing is acceptable than with the 300-baud terminals 
used for IIDA searching. Hence, the professional staff was accustomed to 
doing a great deal of on-Iineprinting, often exceeding the limit allowed for 
IDA users working with the slower terminal. Also. IIDA's design was 
fixed just before Lockheed announced the new SUPER SELECT com- 
mand. Thus, this command was not included in the IIDA training mate- 
rials, and its syntax was not recognized by IIDA's parser. 

Although the intermediaries knew about these limitations, an mad- 
venent transfer of habits from the usual search context into the IIDA search 
context could have introduced some faults or errors which might not 
othenvise have occurred For example, if aseaicherusedSUPERSELECT 
for set combination, then there was an increased likelihood of theappear- 
ance of a large number of SELECT commands without any COMBINE 
command Fhis could then trigger an "excessive string length" diagnostic 
Consequently, although it is not possible to assign numerical values there 
is reason to believe that the professional searchers might have had a higher 
error fault rate than normal. However, it is certainly thecasethat the IIDA 
searchers performed respectably well, and, in terms of final outcome the 
users who did their own searching using IIDA achieved resuhs equivalent 
in utility to those who worked through intermediaries. v 
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The other surprise in the results on user performance came in the 
findings that the two different user groups trained by different methods did 
not differ appreciably either on the diagnostic measures or in the percent- 
age of -useful references retrieved. The original design specifications for 
IIDA did not envision a system which would be competitive with more 
conventional training approaches. Rather, the intent was to provide an 
avenue of access for individuals who could not or would not take a 
conventional training course, but who still wanted personal (rather than 
intennediated) access to a databask It had been assumed that comparisons 
between the two different training methods would highlight difficulties 
with IIDA. One reasonable guess as to the reason for the pattern of results 
reported here is that, while the human instructor may well have been more 
flexible and responsive in assisting the student and in answering ques- 
tions, the design of IIDA does, as intended, enable the user to discover 
where to go to get the information needed to answer questions. 

Performance of the Diagnostics 

Farlier ihe possibility was mentioned that the IIDA diagnostics, 
rather than 'indexing various aspects of searcher behavior, might be irrele- 
vant to the process of searching. This would account for the lack of 
significant differences between IIDA users and professionals, and between 
IIDA-trainerl and conventionally trained users, on these measures. This 
explanation seems, however, to be less leasonable than the idea that the 
system is working as it was designed to work. One reason for not assuming 
that the diagnostics are irrelevant as indices of searching behavior is that 
ihe diagnostics were all empirically developed. In other words, they were 
all designed to index and deal with problems encountered by searchers 
which have been observed by the designers and or repoi ted in the literature 

by others. r 

Furthermore, the relative frequencies of the various types of errors or 
faults correspond reasonably well with the intuitions which originally led 
to the development of the diagnostics. Figure 8 shows the mean numberot 
occurrences per search of the various subcategories of diagnostics, aggre- 
gated over the entire study . Also indicated are the 95 percent confidence 
limits for each type of diagnostic. The diagnostics which were triggered 
most commonly were syntax, relevance and null set generation. A second 
group consists of string length faults and excessive printing. The third 
group tof six fault tvpes, is characterized by relatively low frequency of 
occurrence; in fact, some of the confidence intervals include zero. These 
last six are- response time, command repetition, print format, unused sets 
dwelling, and thrashing. Even though these diagnostics were triggered 
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W 



relatively infrequently, they are probably worth keeping, since the 
response to the open-ended questions on the post-search questionnaire 
suggested that for an occasional user they were useful. 

In general, the diagnostics are mutually independent in that the 
triggering of one has no implication as to whether the others will be 
triggered. There are, however, some exceptions where there is an interrela- 
tion. For example, a string length diagnostic is triggered whenever a 
certain number (») of successive commands of any given type is received A 
dwelling or thrashing diagnostic requires both a string of COMBINE 
ai ] d C l rtai " conditions with respect to the arguments of the 
COMBINES In other words, there must be a string of length m, plusother 
conditions. If the threshold on the string length diagnostic were set short 
enough, that is, if n < m. a user entering a string of COMBINES would be 
warned against continuing that pursuit before the dwelling or thrashing 
rules and diagnostic messages could take effect. The various thresholds 
were set heuristically, and these settings have some effect on which rules a 
searchei is deemed to have violated. Hence, a slight change in the thresh- 
olds might have resulted in the occurrence of one type of diagnostic rather 
than the other. 

Conclusions from the Diagnostics 

Overall, it seems that the various categories of diagnostics do i epresent 
a reasonable :er of measures of the performance of on-l,„e searchers The 
fact that the novice searchers studied were able to achieve a degree of 
satisfaction with the final results equal to that achieved through profes- 
sional searchers suggest thr , with the help of the IIDA diagnostics, these 
searchers performed the search as well as the professionals. Enabling them 
to do so was the goal of the IIDA assistance mode program 

This equivalence would imply that when a searcher has an error or 
fault rate widely divergent from those reported, there also exists a differ- 
ence in performance in some area of searching behavior. In the case of 
recessive errors or faults, this is presumably self-correcting over time with 
repeated exposure to the diagnostic messages and practice. In the case of a 
low error rate, the deviation may indicate a person ready for a language of 
greater complexity. That is, sustained error-free performance probably 
means that the user is ready to take on a language capableof greater logical 
power. Such languages are typically more complex and demandin k in 
terms of what the user mu-st know. 

One important caution is that the IIDA diagnostics were designed for 
use in a certain limited context, that of the training and assistance of the 
kind of users described in the introduction to this paper and in the user 
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studies conducted. There is some indication in the experiences of the 
professionals that when the diagnostics were employed with highly expe- 
rienced searchers, they may not be the most appropriate procedures, i.e., 
there are times when the diagnostics may have been triggered by relatively 
sophisticated searcher behavior which is appropriate in one context, but 
not in situations with which HDA was designed Co cope. 
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Future Research 



Inasmuch as the conclusions drawn about the effectiveness of the 
diagnostics are not as clear as might be desirable, several additional direc- 
tions for future --search should be followed: 

1. Diagnostic evaluation. The overall requirements for evaluation of the 
project as a whole, as well as the available resources, dictated that some 
studies have a higher priority than others. This led to concentration on 
the evaluation uf IIDA as a system rather than a more direct focus on the 
diagnosticxomponent of the system. A future evaluation devoted solely 
to the question of the performance of the diagnostic system, with and 
without various kinds of training in advance, would be both useful and 
desirable. 

2. Longitudinal study. A real limitation of studies such as those described 
here, and of many others on searchei behavior, is the relatively short 
amount of time between tfte participants' first exposure to the system 
and the evaluation of their performance or of the system performance 
In addition, there seems to have been little or no testing of information 
system users at several points to investigate development or change over 
an extended period of time. Inthe studies described above, the volunteer 
subjects generally wanted to ao the whole set of exercises, and then do 
their searching in a relatively short time. It seems particularly desirable 
that a long-ranges udy be done, ovei a period of a year or so, focusing on 
how different people adapt ,o a new system, how quickly they adapt, 
how their behavior changes over link, and how it changes as the result 
of multiple search experiences. 

3. Adaptation to user skill level. As noted above, it is not expected that the 
same diagnostics will be equally useful or desirable for all user skill 
levels. It would bedesirable not only to test the diagnostics on persons of 
differing skill levels, but to test different variations of the diagnostics In 
particular, it seems desirable to test whether, by varying the thresholds 
in the existing set of diagnostics as a function of actual prior perfor- 
mance, it ts possible to get them to perform adequately with persons of 
different skill levels. That : s, can they be made adaptive? 

1 Various user groups. Although the original target user group for IIDA 
consisted of technically trained individuals interested in a particular 
class of search problems, there now seems to be no reason not to attempt . 
extension of IIDA. The technically or scientifically trained users may be 
onlv one of several groups who would find IIDA attractive and useful 
In particular, it seems desirable to determine whether or not a system 
such as IIDA can be used to provide direct database access for a wide 
variety of possible end users interested in a wide variety of seaich 
problems. 
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in summary it seems that a new idea has been fairly tested in the very 

Sne Islets of these results are not entirely conclusive, they support the 
Sea tnTthe HDA diagnostic procedures did adequately measure impor- 
tant aScTo u*r performance. What is morecertain. however, ,s that the 
IDA s^l represents a wav of training and assisting novice users to 
search databases vTith a level of performance that matches that of more 
Z riefced sea" h s Furthermore, HDA clearly represents arable ai er- 
raS tolaSg direct database access for those end users who cannot or 
wU nmengage in mose conventional forms of serach mining. 
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Machine- Assisted Browsing 
for the Naive User 



Introduction 



The purpose of this paper is to demonstrate how a. radically different 
The purpose 01 h inforrration can result in: (1) a 

Son n the user sophistication in th« use of information 

^ " n d (2) the supportof a browsing approach t» information system 
systems, and v . tne w~ _ j h information system daia- 

.Sated with information systems occur precisely at the interface between 
^ and tSluon sJrage- The P^J^ 
user reauests onto the database str icture. The more machine-like ne 
"Z faster the mapping. As interfaces become more sophist,^ 
f e allow the user'to express requests in a more natural form such as 
natuil lan uage), .ore processing is required to earn 
And as orocessing time increases, certain types of search processes (e.g., 
brow ng Wnfe increasingly difficult to provide at a 
^n«rateUntihheumewhenprocessingpowercan 
n^s ots^ em users, in.Wation system design and construction shouW 
co^orm S user needs, meaning that the physical structure should be 
ZoZw "the user's view (logical structure) of the database, reducmg 

ma tt g he a ?o d ,,rng Session, we wil, describe the BROWS* l . gj*. 
database browsing system for computer-naive users'The primary, apphca 
database brow g y^ browsing access to the Carnegie- 

^n bTusS foToIher applications, such as the automat dict.onary. 
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^?3icui. mis is loilowed bv an evaluation of RPrmrcr 
brmvMng ,ool for the naive user. Lastly. weSriS" e BR(S ' 
software used ,o generate browsable informal sys'ls ' ^ 

Characterising the NaVve User for System Design 

sSSSSSsaass 

mmwm. 

cum. uj principle of stiucture oersniniin/ .i.wi ■ , 1 

•nd „hm too idnuifcd ,„,„ fare ^CT' 0 - 
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Time: Hmv long does it take a user to accomplish a given set of tasks using ' 

the svsten*.? , , „„, 

Frrors- How manv errois does a user make and how serious are the>? . 
Teaming: Ho, long does u take a naive user to learn how to use the system 

in order to do a given set of tasks.' 
Functio mhty: What range of tasks can a user do w.th the system? 
RecaU. H<»v eas> ., .s for a user to recall how to use the system on a tank that 

he has not done for some time.-' . 
Concentration: How many things does a user have to k~ep .» amid * Ink 

using the svsu'in? , , 

fri**: How tued do uses get when they use the system for extended 

periods? 

\« unerface shoo':! mu-imue lime, errors, learning, a. d fatigue while 
maxnn./.ng func.onahty. recall and concentration. What these act ua 
Ul ,»es should be depends on the appl.cai.on. Structure ,nd categoma .«, 
; rsp.cu.tv can be measu.ed by experiment: do users ,r,d the "^formation 
L want? Bans has donesuch an analysis, showing , ha, only ,3 percent of 
hbran searches »ho thought thev were successful actually were. How 
well BROWSE sat.sf.es these fac to, s is discussed later in the paper 

Search Methods: Browsing v. Parameterized Search 

The maioutv of research in the area of database access has focused on 
ihe a.ea of ,».a.nete../ed search (PS,. PS can be charac,e.,/ed as str.cth 
k used m he sense that the user must s,,enf> exactly the set of attributes 
Zhe.eco,ds.nusthave.e 

F x about learn.ng." Bes.des the naivete p.oblems discussed aboift PS 
ystenis do not allow quick and access to related reco.ds In order to 
access .elated matenal. a new set of sea.ch parameter must be specified 
Access to related intormation is the essence of browsing. 

Browsing c an be c ha.ac tcrucd as a heuristic searc h in , well-connected 
space of records. In pa.t.cuhn. bowsing can be viewed as an iterative, 
five-step process. 

1 Choose a bowsing attribute, such as a category, author, keyword, etc 
9 Access and peruse entries via the chosen attribute (e.g.. books, technical 

reports, etc.). 
3 Narrow perusal (search) to small subset. 

\. Examine a small subset of entries to con'.rm interest and find ne* 
5. ulnnuryTuggests a new search attribute, then go to step 1 o. elsego to 



step 2. 
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Lad, of the browsing Mc ,» described above is important and is jus. ba.elv 
supported .„ a libran. That is. only the author and categor a „ it Let e 
•ndexed, and distances between shelves impede searches Bo h I a ^ 
. mfonnat.on systems must provide the abil.ty to search and « 
more ....porta,,,, many search a.tnbu.es must be accessible and new 
. bu.es eas.ly searched. Some of the search heu, isiics most comm My used 
browsing library databases are: 

1. If book x is interesting, -hen what else has the autho, <*,f , writtcn > 

2. book x ,s m.erestmg. then what other books a.e in the san,eca.« rv> 

w^:ir ,c,e ,s in,ercs,ing - *T «- ^ 

* l:"::: ,i,m,i,g ,,a,>cr in ■ jou,nai - *» ■*« - . 

' The goal of the BROWSE svstem is to prov.de brows.ng access to 
databases by building the search heuristics direc.K in ,o the I, aba e i° 
c.uick-access pa.hs betwcen.related re.o.ds. Tim includes: , 1 , 
s.mple.ma.wnach.ne inte.fa.e that takes htt.e uaunng to n ^ 
2 nesenung the svstem in such a wav that ,ts logical struc.u.e ,s k 

aa;^"::^ r : , ;;:::r u>od - and ,3) p,ovidins a b ~^' ~ - 

An Example 

s,., e ierRTM? " St<>m <i; " abaSe r ° nS,S,S ° f a ,lM <,f h «"«- A hame ,s a 
single C.R I , Hn ision, « reen of ,nfo„na,,o„. The purpose of the frame 
to pro ,de tnformat.on to the user, and to provide,,..,, L a«ess to fuX 
relate,! ... orn.at.on Opt.ons pu, ide l.nks to ic.a.ed f,a\,,es A 
beiueen the frames bv selecngan opt.on. which .esults ,, theU.s i f - 
"ew ban* f .gu.e . .san example from a BROWSE database, le , 
an on-line hbran catalog s\s;em. '"uopunoi 

The fust frame ( fig I , uel.on.es the use. to the BROWSE s^s,e„. In 

* 7CX if l',* Ti C ° rriCr °/ ? m f,a,m ' ' S "* namp » f '»»• 

*• / "" / ' , 1 hest ' ™»«« global pads, will apnea, in even" 

frame I hev pnn.de a set of svs.en, funct.ons that a.e useful . I, tough out 

to th, BROW SE s* stem and three opt.ons. The fns. option allows the user 
to ron inue rece.v.ng ms.ruct.on on how to use .he BROWSE svs.en, The 
second op„o„ allows me use, to move d^ecly to the top of the classif r - 
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THE CARNEG IE -MELLON UNIVERSITY 
*7 COMPUTER SCIENCE DEPARTMENT 
L18RARy'8ROWS1KG SYSTEM 



ZOG OlffEREHTIATES ME1WECN UPPER AND LOWER CASE •••• 



I. Continue ft>r instruction (Type CAPITAL 1 to continue) 
T To begin 8ROWSIHG. 



heO back next «?rk return top 



N. News 

rn top display comment goto find 



/ 



Figure 1 



,ion hierarchy. The thiid opt.on allows the user to get news describing 
hTngmo the svstem. To select an option, the user types ,n the first ettero 
(he option ("I" to select the first option. "T" for the second. N for the 
Zril U there ,s a pointing device (mouse, touch screen, ™ > 
hen he user need only point to the option in order to select it. The naive 
"ser would continue by selecting the "I" option for more instruction. An 
experienced user would select option T, thus displaying the top of the 
daTs Station hierarchy (fir. 2). There are twelve options to>.s frame 
Opt ons thatcontain a dash (-) after thefirst two characters do not p«nl 
to anv other frames. They are included as pointers to information which 
one da "wi be included. An imporu.nl property of the BROWSE system is 
Zt it can support multiple views .of the database. At present, only the 
imputing Review classification (1976) ,nd a new entries list are 
available. 

Bv selecting option 1 , the user moves on to the top of the Computing^ 
Review classification hierarchy (fig. 3). The frames forming the classif.ca- 
non hierarchy each contain a title (0: Computer Science), a def.n.t.on 
Action, a li 4 of subcategories, an "entry list" option (L), a lost map 
op ion £). and a "parameterized search ' option (S). If there are, 'd.t.onai 
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Top of the Browse-net 

You are now at the "top of the BROWSE -NF T ih» t~\^ 

access paths available for Joking following are the 

V Co«put>ng Review. 

2 -CKtr Computer Science Dept. 

3 -OeweyV^ounts, 
4'-Liprary c^f Congress. 
5 -Author ^ M 

H Mew Entries. 

I Instruction and help mforna'ion 



browser 



8. -Institution 

7 -Keyword 

8 -Journal 

9 -Symposium 
0 -Pub) isher 



h«>p back next nark return tnn 

a reiurn top display connent goto find 



Hguir 2 



sulkaiegorieV (hm a "mor, sele< t.ons" opuon ,s i„< luded <M). Fmally ,f 

' fh ( ' (lass,f,t; " 1( " , fl ^ n <- '<> pnman supraca.egorv. 

rh Z. ''I T p0m ' S '° a ". ,,of ,i,e< ' n,r,<S ,ha « hau " b( ' ( '" 
hnalls. the parame,en/ed search option causes the system ,b bee.n a 
pa.am«cr,«| scare h and procmljo a set of f.ames lha. allows .he user . 
spec if\ die paiattieteis *• •' 

. 'he ,„,„al fe oal of ih.s sample sess.on ,'s ,» brow .hroutdi .he 
, database for mformauon rela.ee! ,« lea„„» s . B> ,e.<c„ng „„• op ion 
Appl,canons ,he user tarns ,ha, .hectors u„ luclesc o^n.ve " s 
In,' I, T " M C ' H !f '■' ,Um " °' ),,0n *r user l.sccn 

If A PF hcauons uas no. a useful <a«e g ory. the Poption could be^ele ,ed 
,<o*<>ba< up.he h,c.areh>. ,oa..o« .he use, u> .-^ anod^. S p 

f^' 1 <^"^^'P>HH,2MlKM,sermou-s,o l |H-f 1 auHHlesc,,lMn^Ar, 1 ic 1 al 

J; l l\ ? ,,,Ul (,iS " m "' S ,IU " iVM " h * " f -tauei r 

(Ixarnm R and Adap.ne Systems, No,, ,h a , .,„ (Wr) trMW f £ 

<a.,gorv If the Use, wan.ee. ,oseeen,„escl,re ( th , , : „U,, uncle n," 
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Thr Computing Reviews 
classification is published In ■> 
Computing Reviews by the 
Association of Computing 
Machinery. (Computing Reviews, 
May 1976). 



S. Parameterized Search^, 
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Figure 3 



3.: Applications 



CATEG109 



Computing Reviews 
\ . Hatura: Sciences [3 1] 



This category contains 
subcategories concerned with the 
use of computers - where, how. 
when, and why they are used. Zt 
also deals with the relationships 
between human cognitive and 
/ perceptual processes and 

3 Social and Behavio/al Sciences/ [3 . 3] computing. 



2 Engineering [3.2] 




4. Human les [3 . 4] 

M. More Selections 
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subcategories concerned with the 
use of computers - where, how. 
when, and why they are used. It 
also deals with the relationships 
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computing. 
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Z Artificial Intelligence p 6) 
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2 Learnn.g and Adaptive Systems [3 62] 
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4 Problem Solving [3 64] 
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This category contains 
subcategories pertaining to 
induction and the formation of 
hypotheses . learning and 
inductive systems; pattern 
recognition, problem solving; 
Simulation of natural systems; 
theory of heuristic methods, 
and general and miscellaneous 
subjects within the broad area 
of artificial intelligence, or 
the machine simulation and 
modeling of human functions, 
part lcularly human 
irttel 1 lgence. 
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3.62: Learning and Adaptive Systems 
Cooputing Reviews 



CATEG158 



Applications in which a computer 
modifies its programs according t 
input and/or memory, including 
modification of logical paths, 
self-adaptive pattern changes, an 
changes in parameter values. 
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Intelligence, he would select option E. With an interest in learning sys- 
tems, the user selects option 2. and the goal category frame has been 
i cached (fig. 7). 

There are no subcategories to Learning and Adaptive Systems. The 
user has reached a terminal fiame in the classification hierarchy The entry 
list (fig 8) is displayed by selecting the £ option. Along with the list of 
entries, this frame contains a pointer back to the category frame leading to 
the entry list (option R), and options to move back and forth through the 
entrv list (option M and option P. which is not shown). This is just one 
foirn of indexing provide 1 by BROWSE. In addition, theautogeneration 
of hietarchical and alphabetical indexes has been added. 

The user decides that entry 6 looks interesting. Selecting that option, 
the frame in figure 9 is displayed. This frame provides the basic informa- 
tion about the article in question. The user may find additional informa- 
tion about the authors by selecting options A or B. If the user wants 
information about the Computer Science Department at Carnegie-Mellon 
University, he may get it by selecting option I. In all three cases, a list of 
entries associated with the author or institution will beavailable. The user 
can gain additional information about thesymposim in which this article 



ERLC 



83 



3.62: learning and Adaptive Systems 
1 
2 



ENTRY89 



3 
4 

5. 
6 
7. 
8. 



ItrZ** " 5 % sludy ,n P r0b,em "iving with king and pawn endings; 
Perdue. C.; Symposium or Conference Paper- 

Encoding Mowledge in partitioned networks. Hendrix. Gary G . Technical 

B.r?VnZr Ce M , Y V * ,UaUon «6- -A program that plays backgammon; 

Berliner, h. Symposium or Conference Paper- 

lctnT r Roge n rT. COnCePtUal U *«"™> 3 P"""' , 

: c r q co:;:;:: C e fr ?: P ::r tural »*..-*. ,. s 
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appeared bv selecting option F. Along with information about the sympo- 
sium, a list of all articles will be provided. Finally, there is a set of options 
that provides additional information about the current entry. Option 1 
will provide a list of at ronyrns and keywords. The keywords are organized 
as a hst of options. If the user wants to see what otheren tries in the database 
share a keyword, he can select that keywoid. The second option provides ^ 
the abstract to the piper. The third option provides circulation informa- 
tion about the entry in the library. The fourth option leads sq a list of 
categories under which the current article has been classified. These cate- 
gories are options that point back into the classification hierarchy. 

Bv selecting option 2, the user ran ^ iew the abstract of the paper (tig. 
10) The user decides that he wants to see additional information on M.S. 
Fox By selecting option A in figure 10, he moves to a frame giving some 
information about the author (fig. 11). Options are provided for linearly 
moving through the author list «.»and going to the author index frame 
it) Bv selecting option I, the user is led to a frame listing all of Pox s 
articles that are currently in the database (fig 12). Seeing nothing of 
additional interest, the use. now dec ides to see Fox's othei areas of .merest 
(fig. 13). 



«MP0MU Abstract 
Knowledge-guided learning of structural descriptions 

A Fox. M.S 

B. Reddy. 0. R . 

we demonstrate how the use of domain dependent knowledge can reduce the 
combinatorics of learning struct-ural descriptions, using as an example tho 

°rfa ^of "alternative pronunciations from examples of spo en wor s 
Briefly certain learning problems (Winston. 1970. Fox & Hayes ' ' 
ca 'solved by presenting to a learning program exemplars £ « »9 
data) -epresentat.ve of a class. The program constructs a characteristic 
reotesentation (CR) of the class that best fits the training data 

rarn'n can be viewed as search ,n the space of represent, t.o.s. Applied 
to complex domains the search .s highly combinatorial due to the 1) 
Number of alternate CRS 2) S,« of training set. 3) Size of the 
exemplars . 
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Figure 13 

Also interested in information retrieval, the user scla.tsoption4.This 
puts him back into the classification hierarchy (fig. H). He may now 
continue browsing in that area. If the user has managed to get lost, there is 
the "lost map" option L. B> selecting that option, the user can get a global 
view of the duplication hierarchy that surrounds the current category 
(fig. 15). Surrounding categories can be reached by selecting any of the 
options. 

Browsing and Searching 

The BROWSE system relies on browMiig as its primary method of 
-database access. However, there are many times when parameterized search 
is desired The user may aheady know exactly what he is looking for and 
should not have to move through the network of frames to get there. 

The BROWSE system includes the ability to specify searches. As was 
shown in figure 2, each category frame in the current system hasan option 
Li allows the user to specify a parameterized search. The parameterized 
search differs from searches in normal PS-based systems in the following 
ways: 
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subcategories concerned wtr the 
systematic computer analysis, 
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1 The search that is initiated is context-dependent. The user may browse 
' through the classification hierarchy until he finds the area in winch he 

• r°nlLted. When he initiates a search at that point, only emr.es 
class S under that category will be searched. Tims, i the user selec ed 
£ 'pantmeteri^ search" option at the frame for Artificial ntel .- 

g nee Te procedure would only search entries directly classified undej_ 
Anttcial Intelligence and entries classified under all of the subcatejfo- 
ries to Artificial Intelligence. 
» When the results of the search are returned to the user, he is able to 
"'browse through theiist of found entries. He may also browse out S1 de ^the 
- S o satisfied entries (follow any link). The current search procedure 
murns a list of frames in the system that satisfy the search parameters. 
1 additional set of options are provided that allow the user to move 
dirouRh the list. The list can bc-viewed as an additional classification 

• structure. Thus, the user can make full use of the browsing capacity of 
the system. 

,The abilitv to combine browsing and searching reduces the problem with 

searches of not finding all the entries «nv***the«er 
Interested. Often, closely related entries are not returned by ti c starch. II 
r«ir isallowed to browse throughout the network, he can often find the 
entries related to the list of returned entries. 

Measuring the Efficacy of the BROWSE System 

We have shown what using the BROWSE system is like. lis purpose is 
to orSna t users browsing access to information. Its success rests on 
how w 11 it Adheres to the principles of interface, structure and category 
^pTcu'ty. Consider the interface factors described earlier: 
' 1 Time- The search heuristics desc. ibed earlier are the primary functions. 
' ' ?h" aTe pro ided by selecting an option in order to transfer to another 
frame Frame change is rapid. Hence, the time it takes to accomplish a 
LToTsingTsk is small. £he response time of parameter.**! search 
dec "nds on the machine, th^ operating system and the program. 
9 FrroM Restricting control to option selection virtually eliminates the 
commandsVen a user make.an incorrect option 
Se t on. the "back," "rerurn" and ' goto" global pads provtdj ■ ,u[ ft- 
dent recovery . If the user gets lost, the lost map fn ,me provides sufficient 

S '/T^Tre- The single most important control construct to be lea.neo is 
opZut^on. This is a simple task to learn. Any othe. tnsmtcuon is 
provided by frame text. 
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4. Functionality: Search heuristics arc embedded in options Other 
/funcnons such as parametrized search are also.pro^idcd Zoo^T 
o. Recall: The pmnary command to be remembered is S T 

-gones by example; he am auicldy access a U the n ±^J" r 
category. As a system for iiaiV- useis RROIvqp P »cul«,r 

Building BROWSE SyMems 

77ic- /Of; Syt/fw 

Hie BROWSE system was designed to use 70r ,u,i . 

philosophv of /Of /or BROWSE, one must understand the 
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front of a terminal on which ? frame is displayed. The frame consists of 
£me text and a set of options'. At the discretion of the user, an opuon is- 
selected andalmost instantaneously a new frame is displayed. The process . 
then starts again. ZOG's basic features' aie^o . . 

1 Rapid fespamK-When* user selec&an option that leads to another 
' frame, the next frame should appear fast enough so tha t the user does 

not feel he is waiting for the system. A user must feel free to explore 
surrounding frames without concerning himself with the time it takes 
to display each frame. , 

2 Simple selection: The act of selection should be a simple uniwy 
' eesture At the present time, there are two forms of selection available. 

(1) single character input from the keyboard, and (2) a touch scieen 
3. Large network: The network should be large enough to provide mostof 
the information needed by the user. 

4 Frame simplicity: The frame display should be kepi simple. The user 
' should be able to assimilate the information contained in the frame 

auicklv Tru idea of- frame simplicity has led to the development of 
tames .hat contain a small amount of text and up to five 
This is not necessarily true of frames developed for the BROWSE 
system, where the simplicity comes from the very structured nature of 
the information. Although a large amount of information may be 
displayed ona single frame, the informauon des.red by theTBcrcan still 
be assimilated quickly. ,u 0 .,k» 

5 Transparency: The usei should be able to understand exactly what the 
svsteni is doing and whatheneedstodotogainadditionalinformat.on. 
Xt no point should the user feel that he has lost control of the system. 

6. Communicatwn agent: ZOG has been designed to act as a communica- 
tion agent between a user and another system. As a communication 
agent 70G presents commands to the user In a simpk format, as well 
an explanation of what the command will do. When the user makes a 
selection. ZOG sends the more complex set of commands to the other 
Ostein for processing. This facility is used by the BROWSE system for 
the parameterized search interface. 

7. External definition: Unlike many menu-select.on systems ZOG- ts 
are databases wh ich are independen t of and external to the ZOG system. 

The basic ,.h t !osoph> of ZOG is .hat a menu-selection system can bean 
effective communication system if the user can move around in the system 
auickly and if there is a large network available to meet the user s needs. 

A menu-selection svstem allows the user almost complete knowledge 
of what is occurring in the system whenever he selects an option. It also 
ullows for related informauon to be located nearby (by placing a link 
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between related frames). Menu-selection systems normally have a disad- 
_ vantage m the i.mc i, takes to move from one frame to another. This is 
solved by th e fast response of the ZOG system. Another characteristic o 
many menu-select.on systems is that the same information is provided to 
all users^ regardless of-the.r needs or expertise. In ZOG. different paths 
would be provided for each level of user. The naive user would get more 
mformat.on about what he i, doing, while the expert user would be 
•presented with only the frames needed to perform thftask 

The BROWSE System Software 

* T OT . Pr ° b,cm W u ith mcnu -based systems is the creation of the 
menu . Expenments w.th the ZOG system have shown that the average 
rate of frame creation ,s approximately five frames per hour. 10 Given a 
database that contams ,n excess of 1 million frames, .(becomes clear that 
some mach.ne-a.ded creation mechanism is needed 

The BROWSE system solution to that problem was to create a soft- 

netwo* Z l ° th , C dhph J SyStem (ZOG) to creatc < hc d ^base 

d Snt' T£ 7* dCS,gncd '° trans,atc 3 da,abase in, ° * f^me 

database. The reasons for us.ng an external database and a translation 
sj .sicm 3 rc. » 

1 . To allow for the modification of the frame formats. The design of frame 
formats and network sutures may change, requiring the frame data- 
base to be recreated. ZOG does not provide facilities for the automatic 
modification of frames and structure. 

2. To allow for the creation of different networks for different display tvDes 
At the present time the BROWSE system runs only on a standard 1 24-^ 

. 80-character d.splay terminal. A completely different frame structure 

would be used for a high -resolution display terminal 
3- To allow for parameterized searches. It would be cumbersome tocarrv 
out the parameterized starch within the frame network. Thus the 

daotaw ^ ° Ut ^ 3 SeParatC pr ° gram that acccsses thc original 

The BROWSE system is a set of software that provides the following 
capab.ht.es: the ability ,0 create a record database and new rtroXnl 
w.th access and search software; interactive programs to query dataXy 
personnel for new entr.es for the database; interactive definition of frame 
a^et k^!^"; * definition of record linkages which define how fn.mes 
art l.nked I .n the frame network; and feme creation, by combining: (1) a . 

newrtrord.nthedaatase.(2)af ra meformatdescription.and(3)alinkaEe 
specf.cat.on; to produce new femes and .updated femes (e g. Sx 
frames), w.th the proper option links, for the frame database. Hence ,he 
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total effect of the software is to translate a. record database intoa browsable 
frame database for naive users. - . . . 

Recognizing that the visual format of frames is important to the 
overall acceptability of the system, we designed the frame format descrip- 
tion language to provide a variety of layout capabilities. The frame format 
describes: 

1. the information to be placed in the frame (fields of a record), 
' 2. the placement of the information in windows on the screen, 

3. the information actually necessary to create the frame, 

4. the options to appear in the frame, and 

5. the type of frame to which each option may lead. 

The frame format consists of (in increasing order of complexity): 
(1) window descriptions, (2) option descriptions, (3) fill descriptions, 
(4) group descriptions, and (5) index descriptions. 

The window description (WD) is the basic unit of the frame format. 
The WD includes information describing a two-dimensional area into 
which text will be placed. The WD contains a starting coordinate for the 
window This position is relative to the group that accesses the window. 
The WD also contains a minimum and maximum length and width of the 

The option description (OD) contains information that relates to 
options in the ZOG frame. Included in that information is the selection 
character for the option, the touch area of the option (in case a pointing 
d-vice is available), the text to be included as part of the option text the 
frame type to which the option leads, and a WD that is to be used to hold 

the text of the option. 

The fill description (FD) describes the information (fields) from the 
database that is to be used to fill a window. The FD also points to a WD In 
evaluating an FD, the system retrieves the contents of the fields in the 
current record. The FD contains information on what to do if the contents 
of a field are null, as well as the text to place before and after the text found. 
All the text specified is concatenated and then placed in the window. Also 
included in the FD is information describing the size, typeface and font to 
be used in displaying the text (for use with a higlwesolut.on display), as 
well as commands describing how to display the text in the window 
(centered, flush fight, flush left, filled). 

The group description (GD) is one of the two major units of the frame 
format. A GD combines a set of FDs (and possibly index description, or an 
ID) into a single logical unit. The GD points to a set of FDsTf the GD is 
describing an option, then the GD will also point to an OD. The GD also 
. contains an absolute anchor point for the group. An anchor defines the 
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™ Potion of he group on the frame. The starting positions provided by 
the WDs and referenced by the GD are relative to that anchor point The 
anchor pomt of the group can be set relative to other grou P V(; e' the 
anchor point of group Xcan be placed one line below the last line used by 
group Y). ' 

The other major unit of the frame format is the index description (ID) 
Associated with every category frame is an option to a list of entries That 
hs .sa linear index, ordered alphabetically by title, toall theentriesin that 
category. One of,the major problems with an evolving system is that the 
indexes to the system must constantly be rebuilt. The ID has been included 
«n the frame format toallow the system tocreate indexes mechanically The 
systems capable of creating a variety of index types (linear, hierarchical 
alphabetical). The ID points to two sets of CDs. The first set rets to 
groups that are used as titles to the index. The second set is used for actually 
creating the ,ndex. The ID also contains information on how to form the 
list of entries to be used in creating the index. 

Conclusion 

The applica::on of computer technology to information and library 
systems hascreateda vista of opportunities. The possibility of a revolution 
in how information is stored, accessed and manipulated beckoned but the 
actual introduction of technology produced as many problems as it solved 
These systems are difficult to learn and use, creatinga serious barrier to the 
naive user. Second, some researchers were clouded in their thinking by the 
way they used information systems. They were unable to see beyond their 
current horizon, thus asserting that computers could not provide certain 
styles of interaction such as browsing. 11 The main effect of this was a 
f^ R tS Kh in ^Parameterized modeof search. The combination 
of the BROWSE and ZOG systems providesa radically different approach 
to the access and display of information. BROWSE and 70G provide an 
integrated browsing and parameterized approach to searching databases 
while utilmngan interface that is simple and clear for even the naive user' 
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Modifying and Designing Computer 
Terminals to Allow Access by 
Handicapped Individuals 



INTRODUCTION 



For handicapped individuals, the primary problems in dealing with com- 
nuter tenZhfell into two categories: manipulation of the keyboard, and 
deaUng^rL information displayed. Manipulauon problems .re usu- 
allv experienced by individuals with physical handicaps, '"eluding the 
^rlv^second category, dealing with the information presented on 
f 2eb moblm f^boTh blind individuals and individuals who may 

fo vtro^me elderly individuals, and individuals y**™£*^ 
oHaneuaee or cognitive disability. Deaf persons generally do not expe 
riela aTdifS in dealing with terminals unless there is significant 
a^nonZZZt Information presented auditorially, either with speech 
or through teeps and other audible cues. With systems designed to func- 
Son in libraries these are generally not significant problems, since the 
sys^ms are usually designed to operate silently or with a minimum of 

. cogn explored, along with the different approaches which 
Sve been used to provide access to textual information. Some of the 
approaches aWs mple; others are complex. The following section of the 
3r wi l examine the praedcal constraints to be considered in 
Kin pub Hcaccessdata processing terminals. These include consider- 
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tll?^ eXpe " enCed bY both th * u * er and ^ manufacturer 
Finally, the paper will reexamine the various solution strategies presented 

SSSL^TS 1, mm ; mUm modificatio " a PP-aches which E£ 
the constraints of manufacturers and users will be identified. . 

Strategies for the Visually Impaired 

Solution strategies for individuals with visual impairments fall into 
three basic categories: (1) visual enlargement; (2) tactile dSys and m 
auditory displays. There are several ways of visually enlargXe 1 
display. One technique is to expand the visual image on the SSC 

arger but means that a smaller portion of the screen is seen at anv one 
t me A second approach is to use a separate magnifying lens This Lh, 

u 6 ™S ni{ y m S !en* can be positioned in front of the 
display either mechanically or manually, and moved by the individual to 
scan the information on the page. This same effect can Z ach eved at a 
muchhigher cost by using a magnifying lens on a closed.ircut Llevision 

a- . The T?,fM nd a PP roach for v 'S"a"y impaired individuals is a tactile 
display. While the first approach is intended mostly for individuals S 
•mpaired vision me second approach is intended primarily ftr ndf dT^ 

a^ual ^Xn J t 3Ctile ft & l basica " y ^ forms ™ fi is an 
actual representation of the characters themselves. The Opticon is an 

example of this approach. The Opticon is an aid which ha a ^ma 1 camera 

about the sue of a pack of gum. This camera is connected to he 1? 2 

of the Opticon, which is about the size of a cassette C ecoX The 

individua moves the camera over the printed letters or the chaWs^n 

the television screen, and the Opticon reproduces, on th ■ f mger t? p of the 

•ndividuars other hand, tl shapes of the letters or characters teiS 

scanned by the camera. In this way, the individual actuany "feels" Se 

various printed characters, and can read them directly This aoo mth h« 

Jhe advantage thatan individual trained in the use ofthS* 

most types of printed or displayed materials without speciaEters The 

Sl£ 7 °h • taCtile diSpl3y inV ° lveS USC ° f * e B " ille t^ Wth 
^ eaCh ^ haraCter ° r gr ° up of characters is represented by a pattern of 
raised dots. These can be punched into piper or presented using dynamk 
Bra. le displays, which have little pins that move'up and down'o nam 
Braille disp.ays are usually single-cell or single-line displays sincT a 
. full-page dynamic Braille display would be extreme! VxpTnsive 
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The third approach to information display for visually impaired 
individuals is the use of auditory displays. This approach can be used with 
both blind and visually impaired individuals. With this approach the 
, information displayed visually is also spoken. Talking terminals of this 
' sort are most effective for transferring bulk text. Selection menus and 
complex visually oriented displays are more difficult to comprehend if 
"simply read from the screen. This is particularly true when two or three 
columns arc displayed. Therefore, special processing of the information is 
usually required, rather than simply having the user read the information 
off the screen one line at a time (which would give thefirstentry oneach of 
the three columns, then the second entry on each column, etc.). 1 his 
approach is almost useless with graphic or charted information as is the 
dynamic Braille approach. The only approaches which are useful at all for 
graphic or chaited information are the enlarged screen and the direct 
tactile translation (i.e., Opricon). ^ 

Strategies for Physically Handicapped Individuals 

For physically handicapped individuals the problem is more com- 
plex, due to the greater variety of physical disabilities. As a result, a wide 
variety of approaches exists to match not only the varying needs and 
disabilities, but also the vai/ing residual control these individuals may 
have This section provides an overview of some of the basic and more 
applicable approaches for use with data terminals. 

AH of the techniques can be broken down into two fundamental 
approaches. The first approach is direct selection. Any technique where 
the individual directly points to the various choices (e.g.. using a typewrit- 
er keyboard or pointing to selections directly on the terminal screen) isan 
example of direct selectibn. The second basic approach is scanning. The 
scanning technique is used wherever the individual is unable to point for 
himself. With this approach, items are presented sequentially to the indi- 
vidual When the desired item is reached, the individual signals by operat- 
ing some type of switch. Thus, the scanning approach is essentially 
"selection in time," while the direct selection approach could be called 
"selection in space." The scanning approach is much slower and more 
cumbersome than the direct selection approach, and is therefore usually 
used only in situations where direct selection is not possible. 

Direct Selection Techniques 

Direct selection techniques can take a wide variety of forms, but all 
essentially provide the individual with some mechanism lor pointing 
These techniques may take advantage of whatever body part over which 
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the individual has best control, including finger, hand,' arm leg knee 
foot, head, or eye. In some cases, the individual can point directly to the 

S ' tl l?l r nter ' etC J ' * USCd (seb f * 2 )- A *«y powerful new 
technique which has received much more application recently is the use of 
opucal, pointers. With this technique, an individual points usinga beam o 
light. This approach has the advantage that the "length" of the beam 
automatically adjusts to the distance necessary to reach the item indicated 

»te r ^ Z l ° CXert mUCh ,esS physical co ™°'- ^ also 

permits the individual to stay in his best position, rather than having to 

lean in one direction or another to reach his choice, as he would with a 
mechanical pointer. This ability to maintain optimal position can greatly 
increase an individual's pointing capabilities. Individuals with good dis- 
crete pointing skills can generally use these various techniques directly 
Other individuals can use these techniques to point, but their pointing 
motions may be mixed with erratic or involuntary jerking motions. The 
individual may not be able to hold his hand, finger, or pointer still over a 
single selection, or may not be able to press a single switch. In these cases 
the auto-monitoring technique" can be used. This approach has an 
averaging effect which allows an individual to point, even shakily toan 
item, and have the system determine which item he or she .s trying to 
indicate. Even if the individual makes occasional wrong selections the 
system can ignore these false signals and pick out the desired target of the 
individual's pointing. 

Most recently, research has begun into the use of eyes for direct 
pointing. Using the eyes to point is very difficult fora number of reasons It 
isn t possible to attach something easily to the eye to use either as a pointer 
or as a reference for sensing eye position. Optical methods fordetemiinine 
eye position have been used, but generally these need to be individually 
calibrated, are sensitive to ambient light conditions or are sensitive to 
position and orientation. Many of the eye position-sensing systems also 
measure only eye position with respect to the head. In order to tell where 
the individual is looking, one must determine where the bead is with 
respect to the target. These two pieces of information (eye position and 

heaapositionnhenneedtobeintegratedinordertodeterminetheposition 
of the gaze. Al though this approach is difficult to implement, its potential 
is great, especially for aids which are custom-fit to the individual Practical 
implementation of this technique with custom aids is, however at least 
several years away. Use of this system for public access terminals, where it 
would need to be self-calibrating and able to work\vith a wide variety of 
individuals, is farther away yet. 

With these various techniques, it is usually possible to find some 
mechanism through which the individual can pointor indicatedir&aly. If 
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Figure I. Direct selection by manual pointing 



' the individual can poiSdirectly, but only toa small number of items then 
muhisignal techniques such as encoding can be used (discussed later) Jft> 
SdivTduals who are unable to point at all. however, a scanning approach 
may be required. 

SC<1 mile techniques are methods where the individual 
himself points, scannin L techniques are basically rnethods-where some- 
Eg o Someone else points for the individual. The individual then 
watches until the desired item is presented. At that time, he gives a stgnal of 
SnTtype to indicate that the desired item has been reached. For an 
MMdual to be able to use this technique, he need only have some single 
mo ion which he can control. This can be a movement of any part oftus 
^ or cessation of movement. An eye blink, a look upward, a 
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movemeni of the thumb, etc. are all acceptable movements which could be 
either observed or tapped using a switch. Because ol this, scanning is an 
extremely powerful technique. «-»"gisan 
The disadvantages of the scanning approach is that it ismuch slower 
This ,s especially :rue if the number of choices is large. If an individual 
must spel out information, for example, it can take a very-long time to 
scar, the alphabet, picking out each letter individually. The time reauired 
to transmit information in this manner ranges from long to excruciatingly 
long, depending upon the amount of information and the individual's 
response time. 

One of the primary reasons for the extended time required to transfer 
information using the scanning approach is that the bulk of the time is 
spent displaying "wrong" choices. In order to accelerate the scanning 
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and page/item scanning (sec fig. 3). 
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Another technique to reduce the number of wrong presentations is to 
arrange the items in order of frequency of use. Thus, the most used items 
are placed toward the front of the scanning routine, since they are more 
probably the next correct item. In cases where selections arc used in a 
certain pattern, such as in English spelling, the most probable next letter 
will vary depending upon' the preceding letter or letters selected. In such 
cases the order of presentation can be changed after each selection to 
display the most probable next selection. This technique should be imple- 
mented with care, however, since it is sometimes more confusing to have 
the selection order change each time, cajising the individual to take more 
time in his selection and thus losing some of the advantages of predictive 
scanning Over long periods, however, the individual may be able to - 
anticipate the changing displays so that this problem can be reduced or 
eliminated. 

Encoding Techniques .... 

Even with the above scanning acceleration techniques, tne scanning 
approach is generally still considered to be a second choice to any type of 
direct selection technique. For situations where the individual can only 
select a small number of items, however, the total selection space (total 
number of possible selections) can be expanded by using what have been 
termed encoding techniques. 

Encoding techniques constitute only one part of a large-- .ategory ot 
techniques which use multiple signals from the user to increase the ' selec- 
tion space" thatan individual would have with direct election, or decrease 
the "selection time" of an individual using the scanning approach. Some 
multisignd techniques for scanning were discussed above, such asgroup/- 

item scanning. 

A parallel to the group/item concept in scanning is two-number 
encoding or group/item indication using direct selection. With this tech- 
nique, an individual who is able to point to only ten numbers could 
quickly select from 100 items by simply pointing to a pair of numbers. One 
can think of this either as indicating a number from zero to ninety-nine, or 
as selecting one of ten groups, and then one of ten items with" Jje group. 
In both cases, the time and movements involved are identical The major 
difference is in how the information is displayed. There are advantages to 
either approach, although the pairing of individual numbers with individ- 
ual choices is almost always the superior approach due to the reduced 
, amount of visual scanning and processing necessary. These individually 
coded selections can then be grouped if desired or appropriate (see fig. 4). 

Thus the advantage of the encoding technique is that itcan be used to 
provide an individual capable of relatively little movement or accuracy 
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with the ability to point to a large number of items. Ten widely spaced 
kevs for instance, could be used in a two-movement encoding technique to 
selectanykey on a keyboard or selection panel. Three-movement encoding r ~ 
would allow one to specify any of 1000 keys or selections. 

Thus it is possible <o provide individuals having a wide variety of 
physical handicaps with access 1 to systems of any level of complexity . 
Techniques exist; in fact, which can allow any individual, no matter how 
severe the physical handicap, to control information-processing systems. 
Choice of the appropriate technique will depend upon the application the 
amount of information' required, the variety of individuals who will be 
using the system, and the amount of modification which can be reasonably 
expected. For custom, personal aids, these constraints would be mucn 
different than for public access computer or information-access terminals. 

Cognitive Considerations 

In addition to the physical and sensory considerations, systems need to 
be designed which can.be used by individualshavingvaryingcognmveand 
language capabilities. Some design considerations are necessary to ensure 
Lf the systems can be used by younger children or by e d erly individuals^ 
In other cases, modifications might be implemented to allow the systems to 
be more easily used by individuals with specie language or cognitive 
processing difficulties resulting form stroke, injury or other conditions 
P typical considerations in this area would be: ( 0 use of simple visua 
displays?. (2) useof large, plainly-marked input panels; (3) use of a minimal 
number of keys and options-use of a hidden-option approach; and (4) use 
of simplecategorical presentations. Mostof theseareself-explanatory.The 
SZ-option approach allows the system to support faster and more 
effidenTd ta entry approaches for individuals who are familiar with the 
system, while.providing a perhaps slower but much more stra.ghuWard 
dat entry or retrieval procedure for other individuals. Two techniques fo 
achieving this are: (1) to make a number of the options invisible so that 
Sey can be called up, but are not necessarily displayed to the nov.ee; (2) to 
have prompted and nonprompted input sequences. 

Practical Considerations and Constraints ^ / 

From theprevious section, it can be seen mat the problem of access lies 
not in finding a method to provide access to these systems for individuals 
w^seTe physical or sensory handicaps. There are a large , number of 
techniques wh.ich can provide very effective interface approaches for in*- 
vtduals with almost any type of physical or sensorv handicap. The prob- 
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tor providing this access. 
User Constraints 

Ensign cons tra i nts fal| imo twQ ^ . ^ consUai d 

manufac t u«r/d,s t „bu»on constraints. The user, constraints will vary 
somewhatde^^ 

will be used. In general, however, there are four basic Jser constraint " 
espcc al y for pubhc access terminals. The system and modifications musi 
be: (I obvious, (2) easy to learn, (3) easy to set up or connecj wi and 4 
reliable and easy to maintain. The first .two are, of course, generates' 
they apply no, only to handicapped individuals, but to the poptdaTion asa 
whole The third is appropriate mainly in terms of use bylhand caoS 
.ndwuluals. Adaption of the systems for these indSl3 

""T? rCquire an Cngineer - Lib ™ ia »* ^e not going 
• «o have the ume to hook up each'indi vidual as he comes in, or to remove of 
put away equipment carefully after each use. If the method for interfacing 
o the system ,s s ,mple. it will.be used. If the system is at all complex 
however, ,< will generally not be connected or maintained. If, in addition' 
he system requires any significant amount of extra training on the pa « of 
die hbrary staff or the handicapped individuals who will use J 
changes of it being utilized are further decreased 

Maintenance is another important area of concern. Will adding these 
capabthttes make the system prone to breakage? A system which ,s in one 
pace, keyboard and d.splay together, will be much more reliableand need 
less maintenance than a system which is built around many separate 
interconnected units No matter how simple and firm the connectors, they 
are always susceptible to being pulled and pushed, knocked, hit and 
jammed. Systems with multiple components from different source also" 
make ,t much more difficult to maintain the system. Extra mechanic ,1 

tST' Whi f " r * " thC Way f ° r -handicapped usersTnd 
he refore removed and replied with each use, are also much more suscep- 
tible to damage and loss. Replacement and maintenance of modified 
systems ,s a very senous problem', and becomes more serious as modifica- 
tions increase in number and complexity. 

Manufacturer and Support Constraints ft 

In addition to the constraints mentioned above, there are a number of 

sv°^ enl O 0nS f W ^ r rCgard l ° thC ma " ufaci » re maintenance of the 
systems One of the first concerns of the manufacturer is cost. If the basic 
terminal costs x, how much more would the terminal cost with the modifi- 
cations included? How much would it cost to research and develop these 
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extra capabilities as a part of the basic design? If a library would pay x for 
the system, how much more might they pay if these features were added? 

Time is also a very important factor for the manufacturer. The goal is 
to deliver a finished product, to the public as quickly as possible. Will these 
adaptations mean another six to twelve months on the drawing board? If 
the system is already in production, can these adaptations simply be added 
jo the system, or will completed terminals have to be reworked? If they 
must be redesigned, what happens to the terminals and the systems already 
out in the field? 

Documentation and, training force up costs and add to the time 
involved. It.costs an incredible amount of money to create user manuals. 
Will these special-purpose features mean additional training materials 
and training time for library staff?- How much extra training will be 
necessary for the manufacturer's representatives? How will this affect the 
cost of the overall systems? 

Practical Solution Strategies 

All of these factors are very real, and must be taken into account when 
considering modifications of systems to optimize their use by individuals 
with handicaps. For this reason, it is not sufficient simply to develop or 
describe techniques for providing access for handicapped individuals. ' 
Instead, it is necessary to tackle the much more difficult task of determin- 
ing tech niques which can not only provide effective methods for access, but 
which also can minimize the cost, maintenance and other aspects necessary 
for the techniques to be practical and implementable. With these con- 
straints in mind, one can examine the various strategies discussed earlier. 
Of particular interest will be the' identification of those strategies which 
can best accommodate the various constraints. 

Strategies for the Visually Impaired 

The first technique discussed was visual enlargement. Displays can be 
made larger through a number of electronic techniques, but these are all 
technically complicated.and would involve extensive modification of the 
circuitry in the terminal. Moreover, magnifying thedisplay in this fashion 
- onh permits the user to view a portion of the overall display. If all of the 
letters were made twice as high (and twice as wide), for instance, the user 
would only be able to see one-fourth of the original screen at a time. To see 
the entire screen, he would have to look at four different displays or be 
provided with some. type of electronic "moving window" which would 
allow him, in effect, to move around on the original screen.This.again, is 
expensive and somewhat disorienting visually. 
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Use of an optical magnifier for this function, however, would provide 
the same basic capability at much reduced cost. Essentially, the terminal 
could be outfitted either with a large magnifier which would sit in front of 
the screen and allow the individual to see the entire screen magnified by 
some factor, or with a large hand-held magnifying lens which could be 
attached to the terminal or desk with a chain. Maintenance, construction 
and replacement of these magnifiers would be very simple. Many libraries 
already have magnifying lenses of'this sort, and visually impaired individ- 
uals are generally familiar with the use of such lenses. 

The second general technique mentioned was the use of tactile dis- 
plays. These displays are almost always very expensive, since they are 
designed using nonstandard technologies. In addition, these systems gen- 
erally require extensive training to be used effectively, and thereforedo not 
lend themselves easily for use with a public terminal. Finally, since the 
systems rarely use full-page displays, some modification of the display 
format may be necessary to provide an easily comprehensible tactile dis- 
play. For these reasons, it would be difficult for terminal manufacturers io 
build any type of tactile display into their terminals. A better approach 
would be to provide an output port from the terminal. This alternative 
would both be inexpensive and providea ready mechanism for individuals 
to connect their personal tactile displays. In addition, libraries that so 
desired could connect to diese ports special tactile computer terminals 
• designed specifically for a given population. 

The questions surrounding the practicality of voice-output or talking 
terminals closely parallel the previous discussions. In general, it would be 
very difficult for computer terminal manufacturers or information retriev- 
al system developers to design voice-output systems as accessories to an 
overall system. Auditory display of information usually needs to be done in 
a method quite different from visual displays of information. One major . 
difference is that a visual display isessentially a parallel display of all of the 
infonnation on the screen. An auditory display is a serial display of the 
information. Layout of the screen, the format of presentation, and the 
methods used to scan displays to select the desired 'information differ in 
large degree. For this reason, the best approach here, too, would be to 
provide a port to which individuals could connect their individual aids. 

Another very simple and cost-effective strategy is to providea compos- 
ite video signal- on an output jack. This would allow the system to have a 
second CRT display. That second display could be anything from a. 
slightly larger television monitor with a moderate expansion of the display 
to a projected television screen. In this manner,' one could theoretically 
have a terminal with a keyboard and a four-by-six-foot screen. With this 
technique, the entire screen can be expanded in size, not just a portion of it. . 
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Computer video output is already provided on some terminals, and for 
other terminals would add as little as $3-$5 to the cost. , 

As withall of the techniques discussed here, the best overall approach 
to the problem of optimizing terminals for use by specific populations of 
handicapped individuals is to contact major centers for the visually 
impaired and to talk with professionals who are expert* in the area of 
adaptationlor this population. They can be provided with the specific 
constraints of the situation, and can offer guidance as to the most practical, 
cost-effective and useful approaches for that particular situation. 

Strategies for Use by Physically Handicapped Individuals 
> As pointed out earlier, the most efficient and straightforward tech- 
niques are those of direct selection. For this reason, attention should first 
be turned to techniques which can be used to implement this type of 
approach. The first modification to be provided should be a keyboard 
guard or mask (see fig. 5). A keyguard or mask is simply a plate of plastic, 
wood or metal which fits over the keyboard and has holes drilled or 
punched in it directly above each of the keys. The purpose of the guard is to 
give the individual a surface on which he can rest and slide his hand 
without accidentally activating the keys. To operate individual keys he 
simply moves his finger, thumb or* dowel down through the holes (which 
are the same size as or slightly larger than the keys). Such keyboard guards 
can be made quite easily and inexpensively. IBM, for example, manufac- 
tures them for all of their typewriters and sells them for about ten dollars. 
Keyguards for public access terminals should be designed so that they can 
be easily attached or removed, to allow use of the terminals by nonhandi- 
- capped individuals as well. When in place, they should be firm. The space 
bar should be treated as any other key on the keyboard, except that three 
holes may be provided instead of one. A cutout the size of the entire space 
bar should not be made in the keyguard, since this usually results in a large 
number of inadvertent spaces by the individual. 

Another approach is to provide alternate keyboards. These keyboards 
could be expanded and recessed (under a keyguard) to facilitate use by 
different handicapped individuals. This approach, however, is very expen- 
sive and would require the fabrication and fitting of various sizes and 
. configurations of keyboards to accommodate different types of physical 
disabilities. Here again, a good approach is to provide an input connecter 
which would parallel the functions of the keyboard. Many handicapped 
individuals who require special keyboards have custom communication 
aids With such aids, they could simply connect to the port, if it used a 
standard code (such as ASCII), and be able toduplicate all the functions of 
the keyboard. 
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Figure 5. Guarded keyboard 



Another very powerful direct selection technique is the use of a light- 
beam pointer. This can be attached to the head, held in the hand, attached 
to a limb, etc., in order to provide an effective means of pointing. One 
technique for implementing the light-beam pointer is to use a long-range 
light pen coupled with a cursor on the terminal screen: the cursormoves to 
wherever the light beam points. Any system already configured to use a 
light pen could be easily modified to use this particular technique through 
software modifications and redesign of the light pen itself. This would 
allow for direcrtoenu selection of items by individuals with fairly severe 
physical handicaps. It would also facilitate ease of use by elderly individu- 
als or individuals prone to fatigue, for whom normal light pens may be 
difficult to use for extended periods of time; they could simply hold the 
light pen in their lap and point it at the variousjifcms on the screen If a 
"keyboard" were provided at the bottom of the screen, individuals could 
use thelightpenfortypinginentries,aswellasforselectingitemsfrom the 
memUf the menu used up the entire screen.a white square in onecornerof 
the screen could be used to allow the individual to switch from the menu 
display to a keyboard display to type in his messages. With this technique, 



ACCESS BY THE HANDICAPPED 



115 



. • u ^crrihwl earlier cou.S be used to allow 

the "auto-monitonng technique . d * OT, ™®" ie " ± system 

ton having .0 UK a slowly JSi 'or 

— ."-IT KZ aSSi^ holding down a 

merited within the terminal, ine om ' f h modi f ica . 

T ^JT^ZtZCt^?* invisible to anybody 
algorithm. The actual scanmi g ld ke his selection 

using the ^J^J^^^^faAion. The special scan- 
using ihe keyboard or light pen in .mt : norm triggered by a 
ningsoftware routing 

•switch closure coming into w"* 8 ^ A • es on the ^11 one at a 
timC - e^^mTein^^ 

,s received from the » n P ut ^ establishes a comfortable scanning rate, 
lar item from the menu and al oe *bh ltadditionalmenuscan s, 
Subsequent switch ^^J^^^Z^Ao'M always include a 
. always at the comfortab le «n »a£S ^ h a S J em individual se lected 

Fc, larger numta^*o,c« M. ^5S!hfW»-*« 

not only significant narawarea Although these techniques 

can be more efficient ">ansome . pl iblic access terminals. 



O 1 1 Q 

:RIC AiJ 



116 



GREGG VANDERKEIDEN 
SUMMARY . . 

providing ! S d tLt»,^4" d ™'°i*« *» 
need 10 Kfmadebevond iho<e wlXl 8 "™ber of consideiaV»ns 

straints, however there a«» «imni. i P Even w,th these con- 
made tocomput terminals ^ o fnhl ^ modificatio ^ which can be 
-wide variety oSJKSftES*" 1 ^ the,r , USC by indi viduals having a 
^n^t^^^^ST^ * 'ft? m -^i«cations canbe 
for the system. Man of th T^SX^ ^e^ardware and software 
relatively low ccJ^^^^^^^^^^ 
initial design or in retrofitting ;n modlfl cations, either in the 

indSSals who would o hSX ui^"^ " """^ ° f 
result not.only in bei«er J^^^^-^™ia» 

W"ewi°bopportuni^^ T alS ° 

and maintaining such databases or uiJSS^^ mie ^ W 



er|c i^o 



S ALLAN H. LEVY, M.D. 
• Professor of Computer Science and Clinical Sciences 
f uSershy of Illinois at Urbana-ehampaign 



Resistance to Technology: Some Examples 
from the Health Care Delivery System 

LTtemm to^xplore some of the factors that arc at work when 
this paier to attempt to « . Pt tine • I will try to separate 

the introduction of laboratory information sy 

ilhistratesome 

,Kh w;°S« worked lo, many y<ars wish physicians Tying .o da*n 
Sr,!S&t Ud us .0 _c hands-on 

from the NitionaLtibrary of Medicine. U.S. Public 



•Supported in pan by a training grant 
Health Service (NLM 0701 1). 



117 




121 



"* ALLAN H. LEVY, M.D. 




participation of the health professional in tt™ ~ i 

informatiqr. system We have H«l n I °P eration of the 

** be useful Before beginning & tS&Sg f ^ 

■hese £. are SS^ftT"* *F ' Wh ™ 

surprije ,har ,hc problem was concealrf7™^i ,s , asoura »'"nmer.-e 
really a ease of „„, wan,i„ B °„S tbluT, ° ' ? " T CaSC *' " ,ras 
lask «> cvafuare you, own work I 1 ^r. Problems, ft is no, an easy 

~r"S&ST =o,^. Shi - - »' r 

SSSSiSmS^^ 

«ion: to fail may £ beyond the comro oT .^ ctors ra » si "« 'nnova- 
a-nenahie to ch an g es add 

Medical Information Sys.ems-Their Promises and Their Problems 

' was v'e^ut^ .here 
systems in hospitals and in other Sm^ 52 H«„ n * ,nr0rma, r 
°^<°P-hepic«ureinsomepersp^ 



i22 



TECHNOLOGY RESISTANCE IN HEALTH CARE 



119 



' • as it was at that time, and also to note'the changes then occurring within 

■ the health care system itself. -Lk..i.k.««i>«i«wonh 

• In the sixties the problems associated with health services were only . 
r . banning to W« a pressing national issue. Several factors predomw 
S Ser had been an enormous expansion in the capacity to provide 
4 Xte and Hfe-benefiting therapy with the advent of anubrotics blood 
' Uan usions and new vaccinations. This was accompanied by rap.d social 
' 'chanS emerging after World War JL There w^-a growang perception 
SScal^rvices were not just a privilege op«?n to die 

• rather a national resource to be widely aval able to all social I 
immediate result of this was a tremendous increase in demand for health 
r^se^s lust as we face today a biomedical information explosion, the 
S^e aSf explosion in the actua^delivery of medical and other • 

> S£h« ^services. Hospitals and other health delivery institution, were 
LuemeTiU-prepared for those drastic changes in the usual pattern of 

' TlSlein basic medical research had not been accompanied by a 
, * stud ^ of fays to make such research benefits available to the people in he 
orm o effective care. As a result, hospitals, starting from marginal ef 
den Q ^ quickly found themselves in serious difficulties keeping up with 
the demand for expanded services. - - 

■ ' The consequences were profound. Costs began to skyrocket as hospi- 

tals-nk^ mTand more personnel. Always a labor-intensive industry 
h .Sewrespecially susceptible to damages through rapid expansion 
of it relatively inefficient, but very numerous, service personnel. 
° f A h" time,' a variety of expensive diagnostic and ana lytic ^instru- 
ment, were introduced. These added both to the costs and to he gross 
SnT o n otation generated and the complexity of patient c*«. 
Foremost among these was the automatic laboratory analyzer. This ingle- 
SEE. had as profound an influence on medical care pracuce and cost 
as anv other single development in the last two decades. Prior to tne 

• utom^cSnicanaboratoryana^ 

ily expensive. More than that, they- were unreliable: the analytic instru 
menThad such' substantial variations that physicians were actually 
uaintl to ignore results of laboratory tests when they did not fit in with 
dfagnt ic hnpressions based on bedside, observations. The high speed, 
a Iraa and relatively low cost of tests performed with automatic analyz- 
m chairthat The role of laboratory tests in clinical practice moved 
Tmktrusted ancillary to the very heart of the diagnostic process. 
MediilXatlon changed rapidly to accommodate this new technology 
The Se and interpretation of laboratory tests became an important part o 
S school andxesidency training. Physicians began to order tests not 
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only to confirm suspicions, bui.fo rule out previousfy unconsidered or 

What was the extent and quality of the resistance to the introduZn o 
automata high-speed laboratory analyzers? The Stance was suroris 
•ng y enough, very scant in both duration and intensity SS S 
could scarcely increase the capacity of their, laboratories^st Enough to ™ 
tesu at a speed sufficient to satisfy the demand of the cfiniS who 
ordered these tests. A widespread reliance on results, in teStoth 
d agnosts^nd future treatments, grew rapidly. Automatic ^aly^ers of 
higher capacity and greater speed were developed. What resistant there 
was took the form of counsels of caution by medLl edncatorTSadv £ 
was heeded tn theabstract. but largely ignored in practice. SeniorTnS sfc 
continued for a time to warn, against the "indiscriminate ordS of 
laboratory tests." However, the ever-increasing volume of tes s actuallv 
ordered is evidence of the ineffectiveness of th* attempt at SiSffi 
parsimony and strict rationality in the ordering of Uboratory^ * 
It is worthwhile to examine some of the apparent reasons for the hieh 
degree pf acceptance of laboratory automation Possiblv the'most obvious 
single factor is the economic impact that automated testing has imposed I 
has produced a high volume of increased activity-with accompam in^ 
revenue-for the clinical pathologist. It has not taken revenue a"Tfr2 

Te paidrbv 0 the hC T^' II ^ «° 

care paid or by the patient or the patient's third-party payer. 

It is often the case in medicine that technical developments in onearea 
do not reduce the volume of activity in another; it is more like y that S 
new innovation will simply be a new service not previously i cd 
ideally and presumably improving the quality of care S,I PP" CU . 

Economic factors are probably among the most important relating to 
the acceptability of new developments. Where an. innovation is nine 
economic self-meres, of a group, it is likely to meet widespread acceptance 
within that group. Where that group controls its use. it is like y to gl 
widespread currency throughout society. unl«s opposing pressures a re ' 
deteSsm- 0 ^ ^ COns ^ ,ucnces follow Z m fhis economic 

1. Resistance can be better understood in the light of an understanding of 

whose economic interests will be served and whose will be"fiuYt 
2- Often t he impact of a technological development is only considered and 
control ed by the group which will be benefited; others who may be 
adversely affected are frequently unaware of the impact of new develop! 
rnents on them until widespread changes are already in^lace. 

m 
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- The Introduction of Technology to the Ward-A Model 
of Cyclic Resistance 

Farlier it was mentioned that the rise in demand for health services 



122 



ALLAN H. LEVY, M.D. 



9 

tic 



of medical schools in the UnitedStates. Theeffect of ,h;« ,h ' 
recognirulearlyasserious problems N«3»TTi™ ? mTOe 

it is hard to document the amoMn'f^ftUo^ • , 

operated hospital, one out of four reaul fn f , ? un,vers,t V 
answered with a "rann^r i« . .. re< l uesls for a medical record was 

pa..™ car, services. Manual o^S to^ ^"^ 

'' SS^""" 3 rral " time ' °- line « - « yet suffi- 
2. The software that would permit the rapid development of new nr . 
grams, and their easy modification in response tc * 
not available. Assembler languages w£ « S X^S fa 
produa.cn programming, and high-level language wh"ch eas lv 
accommodated text manipulation were not in commTn use * 

126 



TECHNOLOGY RESISTANCE IN HEALTH CARE 123 



« 



design specification may have been known, but was nol commonly 
practiced. All too often, systems were set forth by the programmer- 
v analyst, cast in concrete by the coder, then sent forth for the first time for 
the inspection of the user. 
With these deficiencies, it is no surprise that early hospital informa- 
tion systems almost universally ran into serious opposition from their 
various user constituencies. Nurses were called upon in many cases to be 

- the direct users of the systems. Ill-trained in admimstration, but with 
increasing management tasks thrust upon them, head nurses now had 

■ either to enter data directly or to supervise the clerks who did. With the 
system deficiences outlined above, this additional task was time- 
• consuming and frustrating. Since no discernible benefits accrued to the 

' nursing service from the information system, there was no accompanying 
motivation to use the system. # j . 

The- physicians and other professionals involved similarly viewed 
early systems as impediments-as part of the problem, rather than as steps 
tojhe solution. Of course, there were exceptions; some medical profession- 
als became enthusiastic about the potential benefits of the system-the 
opportunity to have clinical information available for research, the chance 
to have an adequate data base for planning rational treatment, the poten- 
tial for more effective uses of hospital personnel resources. These intended 
benefits were the raison d' etre for hospital information systems, unrealized 

as they were. ' . . 

The result of these unmatched expectations was predictable. Medical 
information systems lost their charm to physicians and hospital adminis- 
trators alike. Interest in developing them dropped sharply .both on the part 
of medical researchers and commercial software companies, as it became 
- apparent that success in such efforts was unlikely. Progress in the field 
slowed considerably, with the exception of continued efforts in computer- 
based hospital billing. Medical information was viewed by the developers 
of such systems as primarily data that reflected fiscal events, rather than 
from the point of view of their medical content. 

Thus another wave of growth followed, this one emphasizing the 

- accounting, business and collection (ABCs) aspects of hospital operations 
This in general, is the present state today. Several large vendors sell 
business-oriented hospital information systems. These are largely success- 
ful in helping hospitals capture charges. In the process, they also facilitate 
more complete and timely processing of orders to laboratories and phar- 
macies Thus, they do benefit medical cafe indirectly. But they are largely 
insufficient in terms of their potential medical content, and they have not 
reached the goal of -ajding more' rational medical treatment as was origi- 
nally set forth. V 
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Within the past year, however, the availability of inexpensive raicro- 
processers, and the ability of hospital clinics to devise special-purpose 
information systems tailored to. their individual medical needs, has insti- 
tuted still another wave of developments. Sma.ll, medically oriented infor- 
mation modules are becoming increasingly prevalent in hospital and 
clime environments. These are meeting with jnuch less user resistance 
than did the earlier systems. A major reason for their acceptance is that they 
work. Although this sounds likea truism, it is probably themost powerful 
factor compelling acceptance of an innovation. If it produces thepromised 
results-even at a higher cost-it will usually be accepted. Also, the new 
systems are often-either locally designed or skillfully tailored to local needs 
This direct personal involvement is a powerfuTforce stimulating accep- 
tance. (But it should be realized that the personal involvement of the user in 
the creation of a system can lead to noncritical acceptance of a system that 
really is not demonstrably effective.) Finally, thereducedcostandintrinsic 
higher reliability of new computers has been a significant factor in prom- 
oting the success of recent developments. 

Thus, after a poor start, -with resulting emphasis on predominantly 
fiscal functions, changes in technology have again brought forth a new 
wave of developments.' Now, medical information systems are being 
recreated with increasing success and with new emphasis on clinical 
decision support. Resistance can be overcome by the personal involvement 
of the users and by improvement in the intrinsic quality of the tools of 
technology. 



Summary 

The attitude of society to technology is still difficult to predict. This is 
disappointing to innovators, if not surprising to analysts. Society-or even 
smaller segments of it, such as the health services community-has no 
single common goal and no agreement on the weighting of utility values. 
Thus, the first step in introducing any new technological development is 
to decide in advance what the expected goals are and to set forth the 
expected benefits and anticipated losses. No technological innovation is an 
unequivocal blessing. There may not be universal agreement with slated 
goals, but at least their explicit existence provides a bench mark against 
which to judge the success or failure of an innovation. 

Although an analysis of economic benefits for the involved groups 
will be a powerful predictor of the attitude of those groups to a technical 
innovation, other, less tangible factors are involved as well. The percep- 
tion by an individual of thestatus of his job is an importa.it determinant in 
.he success of a system. The participation of users in the design of a system 
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will help ensure their cooperation in its implementation. However, such 
rnvolvement may lead to uncritical acceptance, and may bias , «» 
Xtiveness analysis. In spite of this, user involvement ,s the smgle most 
powerful technique that can be used to ensure system success. 
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